-- Logs begin at Wed 2022-09-14 02:01:48 UTC, end at Wed 2022-09-14 03:08:05 UTC. -- Sep 14 02:31:44.946952 dv-cinder-857075-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 02:31:44.954952 dv-cinder-857075-6-smb devstack@keystone.service[88117]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 02:31:44.957496 dv-cinder-857075-6-smb devstack@keystone.service[88117]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 02:31:44 2022] *** Sep 14 02:31:44.957630 dv-cinder-857075-6-smb devstack@keystone.service[88117]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 02:31:44.957743 dv-cinder-857075-6-smb devstack@keystone.service[88117]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 02:31:44.957848 dv-cinder-857075-6-smb devstack@keystone.service[88117]: nodename: dv-cinder-857075-6-smb Sep 14 02:31:44.957958 dv-cinder-857075-6-smb devstack@keystone.service[88117]: machine: x86_64 Sep 14 02:31:44.958061 dv-cinder-857075-6-smb devstack@keystone.service[88117]: clock source: unix Sep 14 02:31:44.958163 dv-cinder-857075-6-smb devstack@keystone.service[88117]: pcre jit disabled Sep 14 02:31:44.958264 dv-cinder-857075-6-smb devstack@keystone.service[88117]: detected number of CPU cores: 4 Sep 14 02:31:44.958370 dv-cinder-857075-6-smb devstack@keystone.service[88117]: current working directory: / Sep 14 02:31:44.958489 dv-cinder-857075-6-smb devstack@keystone.service[88117]: detected binary path: /usr/bin/uwsgi-core Sep 14 02:31:44.958597 dv-cinder-857075-6-smb devstack@keystone.service[88117]: your processes number limit is 47680 Sep 14 02:31:44.958711 dv-cinder-857075-6-smb devstack@keystone.service[88117]: your memory page size is 4096 bytes Sep 14 02:31:44.958823 dv-cinder-857075-6-smb devstack@keystone.service[88117]: detected max file descriptor number: 2048 Sep 14 02:31:44.958927 dv-cinder-857075-6-smb devstack@keystone.service[88117]: lock engine: pthread robust mutexes Sep 14 02:31:44.959173 dv-cinder-857075-6-smb devstack@keystone.service[88117]: thunder lock: enabled Sep 14 02:31:44.959470 dv-cinder-857075-6-smb devstack@keystone.service[88117]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 02:31:44.959652 dv-cinder-857075-6-smb devstack@keystone.service[88117]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 02:31:44.999489 dv-cinder-857075-6-smb devstack@keystone.service[88117]: Python main interpreter initialized at 0x5590b44189c0 Sep 14 02:31:44.999489 dv-cinder-857075-6-smb devstack@keystone.service[88117]: python threads support enabled Sep 14 02:31:44.999489 dv-cinder-857075-6-smb devstack@keystone.service[88117]: your server socket listen backlog is limited to 100 connections Sep 14 02:31:44.999489 dv-cinder-857075-6-smb devstack@keystone.service[88117]: your mercy for graceful operations on workers is 90 seconds Sep 14 02:31:44.999823 dv-cinder-857075-6-smb devstack@keystone.service[88117]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 02:31:44.999910 dv-cinder-857075-6-smb devstack@keystone.service[88117]: *** Operational MODE: preforking *** Sep 14 02:31:45.000177 dv-cinder-857075-6-smb devstack@keystone.service[88117]: *** uWSGI is running in multiple interpreter mode *** Sep 14 02:31:45.000177 dv-cinder-857075-6-smb devstack@keystone.service[88117]: spawned uWSGI master process (pid: 88117) Sep 14 02:31:45.000377 dv-cinder-857075-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 14 02:31:45.001390 dv-cinder-857075-6-smb devstack@keystone.service[88117]: spawned uWSGI worker 1 (pid: 88131, cores: 1) Sep 14 02:31:45.001723 dv-cinder-857075-6-smb devstack@keystone.service[88117]: spawned uWSGI worker 2 (pid: 88132, cores: 1) Sep 14 02:31:45.001878 dv-cinder-857075-6-smb devstack@keystone.service[88117]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 02:31:49.439687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 02:31:49.439687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: from cryptography.utils import int_from_bytes Sep 14 02:31:49.440431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 02:31:49.440431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: from cryptography.utils import int_from_bytes Sep 14 02:31:49.450879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 02:31:49.450879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: from cryptography.utils import int_from_bytes Sep 14 02:31:49.453450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 02:31:49.453450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: from cryptography.utils import int_from_bytes Sep 14 02:31:49.494924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 02:31:49.495111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 02:31:49.495359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] command line args: [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 02:31:49.495661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 02:31:49.495837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ================================================================================ {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 02:31:49.496090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] admin_token = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.496335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] config_dir = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.496541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.496777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] config_source = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.496953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] debug = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.497149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.497656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.497755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.498684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.498684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.498684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.498684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_config_append = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.498953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.498953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_dir = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.499065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_file = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.499302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.499548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.499629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 02:31:49.499781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 02:31:49.499874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.499981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] command line args: [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 02:31:49.500268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.500425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 02:31:49.500551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.500629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ================================================================================ {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 02:31:49.500755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.500833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] admin_token = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.500945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] config_dir = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] config_source = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] debug = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.501970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502490 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.502924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_config_append = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] publish_errors = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_dir = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503409 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_file = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.503896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] standard_threads = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.504939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] use_journal = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] use_json = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] use_stderr = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] use_syslog = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.505903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.506025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.506104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.506278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.506363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.506594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.506692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.506881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.506976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.507117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.507367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.507444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.507547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] publish_errors = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.507628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.507787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.507871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.508024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.508101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.508206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.508289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.508455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.508540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.508693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.508819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.508930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] standard_threads = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.509009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.509155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.509235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.509396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.509473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.509575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.509658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.509738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] use_journal = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.509897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.509981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] use_json = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.510062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] use_stderr = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.510132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.510241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] use_syslog = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.510372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.510484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 02:31:49.510654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.510761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.510899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511006 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.511902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.512009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.512923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.513866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.514859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.515972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.516980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.517929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.518901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.519930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.520953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.521895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.522883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.523969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.524988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.525908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.526024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.526090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.526323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.526410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.526580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.526817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.535604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.535705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.535705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.535901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.535960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.535960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.536949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.537998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.external = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.538848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.password = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] auth.token = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.539957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.540996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.external = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.password = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] auth.token = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.541994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.542204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.542284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.542433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.542532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.542857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.543842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.543992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.544976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.545935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.546894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.547940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.548952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.549908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.550938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.551998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.552951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.553900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.554875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.555981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.556989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.557925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.558893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.559569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.559659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.560651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.560766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.560940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.561936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.562973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.563990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.564952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.565969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.566964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.567984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.568897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.569925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] role.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570707 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] role.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.570966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.571968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.572962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.573993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.574133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.574257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.574379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.574523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.574523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.574761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.575330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.575464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.575581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] role.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.575702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.575823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] role.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.575905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.576936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.577946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.578988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.579992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.580113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.580234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.580394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.580598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.580820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.580946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.581833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.582979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.583874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.connection = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.584892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.585926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.586908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.587814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.588953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.connection = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.589687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.590730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.590730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.590730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.590730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.590730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.591069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.591248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.591372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.591589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.591831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 02:31:49.592007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 02:31:49.622251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.622516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.622776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.623193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.623426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.623654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.631109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.631986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.660593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.660814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.660964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.661095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.726842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.727016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.776864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.777129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.777220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.777459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.938227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.938454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.938704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.938931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.939147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.939364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.939829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.940057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.940275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.940490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.940703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.940913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.962153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.962405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.962597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.962685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.962832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.962934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.963885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.974640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.974998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.987777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.987979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.988913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.989043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.989127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.989254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.989461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:49.989667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 02:31:50.005986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.006201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 02:31:50.006330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.006566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 02:31:50.006651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.006768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 02:31:50.006906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 02:31:50.007296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.007901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.008088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.018534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.018644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.018817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.018900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.019089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.019172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.019373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.019465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.026332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.026422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.029489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.029585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.029766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.029849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.030989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.031990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.032095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.032257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.032340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.032521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.055663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.056084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.057150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.057437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.057596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.057876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.062352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.062670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.062757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.062971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.063064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.063348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.069395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.069694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.069791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.069971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.076078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.081709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.081821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.081904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.081980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.082913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.094334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.094450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.094827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.094929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.098445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.098631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.101680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.101972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.102100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.102267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.106227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.106557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.109341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.109697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.112546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.112852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.113991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.114076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.114266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.114577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.129637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.129926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.130193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.130455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.130571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.130897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.131168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.131425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.138037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.139396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.139586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.141051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.141148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.141369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.142604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.142879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.144025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.144334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.144618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.144910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.145299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.145605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.145896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.146177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.146455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.146852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.157209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.157493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.157777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.158064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.158449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.158756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.158894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.159047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.159172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.159547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.159824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.160207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.160499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.160777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.174547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.176431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.177470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.179387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.180437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.181883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.182342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.183376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.183674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.183796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.184099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.185532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.185811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.186254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.190486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.191968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.192685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.194122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.194867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.195264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.195557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.195837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.197043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.197474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.197760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.198036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.204558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.204851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.205136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.206448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.206760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.207115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.212065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.212354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.212637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.212918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.213193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.213465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.213750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 02:31:50.214310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.214971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.215153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.215239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.215493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.215632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.215768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.215853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.216231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.216502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.216778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.217059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.217325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.217588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.217853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 02:31:50.250580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5590b44189c0 pid: 88131 (default app) Sep 14 02:31:50.253013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5590b44189c0 pid: 88132 (default app) Sep 14 02:31:50.253839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc185-f4c1-4e56-957b-ef3c2cc4113a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:31:50.254126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc185-f4c1-4e56-957b-ef3c2cc4113a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:31:50.254401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cc185-f4c1-4e56-957b-ef3c2cc4113a None None] PATH_INFO: `/v3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:31:50.258642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Sep 14 02:31:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:31:57.936672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:31:57.937195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:31:57.937195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:31:57.941535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:31:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:31:57.946867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:31:57.947321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:31:57.947416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:31:58.019302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: INFO dbcounter [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] Registered counter for database keystone Sep 14 02:31:58.038928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG oslo_db.sqlalchemy.engines [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 02:31:58.045896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writer thread running {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 02:31:58.227337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG passlib.handlers.bcrypt [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 02:31:58.227641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG passlib.handlers.bcrypt [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 02:31:58.285826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:31:58.287458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:31:58.413452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:31:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 02:31:58.901062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:31:58.974913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: INFO dbcounter [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] Registered counter for database keystone Sep 14 02:31:58.999619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG oslo_db.sqlalchemy.engines [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 02:31:59.005851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writer thread running {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 02:31:59.124872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10037ba9-9dc1-48ae-beb2-6b06fca04917 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:31:59.129181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:31:59.129798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:31:59.130077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:31:59.130347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:31:59.139021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:31:59.190985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING keystone.common.rbac_enforcer.enforcer [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 02:31:59.191330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6afac-d9a2-4c3e-bde6-936d29016cd5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:31:59.200867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 14 02:31:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 02:31:59.206758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:31:59.223955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75548ccf-f25e-460d-aaea-a6706591f729 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:31:59.228335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:31:59.229442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:31:59.229724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:31:59.229993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] PATH_INFO: `/v3/projects/08712a2fc7d14bcea78d3e24178be8ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:31:59.232603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] RBAC: Authorizing `identity:get_project(project_id=08712a2fc7d14bcea78d3e24178be8ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:31:59.287897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 02:31:59.288246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3902374-fc78-41ac-8ac3-96e35526970d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:31:59.292913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Sep 14 02:31:59 2022] GET /identity/v3/projects/08712a2fc7d14bcea78d3e24178be8ca => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:01.446300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fda4b8-08ec-4ab6-94e4-e68af761154c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:01.446843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fda4b8-08ec-4ab6-94e4-e68af761154c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:01.446928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fda4b8-08ec-4ab6-94e4-e68af761154c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:01.451365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:01.456852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:01.457253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:01.457409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:01.477203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:01.478754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:01.487027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 02:32:01.770518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fda4b8-08ec-4ab6-94e4-e68af761154c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:01.782884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fda4b8-08ec-4ab6-94e4-e68af761154c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:01.787149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09024b0b-efc5-4450-a8aa-2c677b74084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:01.787750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09024b0b-efc5-4450-a8aa-2c677b74084f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:01.788033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09024b0b-efc5-4450-a8aa-2c677b74084f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:01.788306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09024b0b-efc5-4450-a8aa-2c677b74084f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:01.796095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09024b0b-efc5-4450-a8aa-2c677b74084f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:01.797870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09024b0b-efc5-4450-a8aa-2c677b74084f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:01.806452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Sep 14 02:32:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:32:01.812522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:01.821506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e576ac-071b-431d-b614-3791b2ee5e85 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:01.826869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76897f-0f1c-4f33-b0ea-19ab2433aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:01.827495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76897f-0f1c-4f33-b0ea-19ab2433aadd admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:01.827777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76897f-0f1c-4f33-b0ea-19ab2433aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:01.828055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76897f-0f1c-4f33-b0ea-19ab2433aadd admin admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:01.829354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76897f-0f1c-4f33-b0ea-19ab2433aadd admin admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:01.831201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76897f-0f1c-4f33-b0ea-19ab2433aadd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:01.832709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Sep 14 02:32:01 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:04.102583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c15e1-81c8-40f8-9d36-c37e106dfc50 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.103152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c15e1-81c8-40f8-9d36-c37e106dfc50 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.103152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c15e1-81c8-40f8-9d36-c37e106dfc50 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.104496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:04.111449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b3b2-13b5-47dd-8206-fce87c4e0638 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.112038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b3b2-13b5-47dd-8206-fce87c4e0638 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.112194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b3b2-13b5-47dd-8206-fce87c4e0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.132178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4438b3b2-13b5-47dd-8206-fce87c4e0638 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:04.133365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4438b3b2-13b5-47dd-8206-fce87c4e0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:04.218384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:04.221382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabfd0-40de-4600-8667-72aff428f58d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.221665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabfd0-40de-4600-8667-72aff428f58d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.221937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabfd0-40de-4600-8667-72aff428f58d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.223290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 6/12] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:04.228427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.228714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.228989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.248732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:04.249934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:04.266507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:04.318990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:04.496055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabfd0-40de-4600-8667-72aff428f58d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:04.584146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:04.639948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabfd0-40de-4600-8667-72aff428f58d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:04.675541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:04.676395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.676676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.676946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.687948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:04.688091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457418d-5c4c-47fd-938c-6980798ea82a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:04.696807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:04.697752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:04.698628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:04.706253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:04.722925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:04.723538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.723816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.724087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.740391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:04.751783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:04.791790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:04.793378 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:04.808517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d01092-3fa7-4e52-adc9-66c24548fdd8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:04.842318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:04.842965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.843279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.843530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.844479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:04.844942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:04.846622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:04.859094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:04.864636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:04.891515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 02:32:04.897211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:04.949072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:04.955457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:04.961132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b6ce-8135-410a-8db3-96bfb86a8efe None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:04.993987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:04.994671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:04.994951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:04.995219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:04.996020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59785446-80ed-4214-a353-b881c5da1b45 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:04.996911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:04.998381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:05.000007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:04 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:05.005555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:05.031597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:05.032445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:05.032761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:05.033037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:05.043905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:05.045349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:32:05.062749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:05.063814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:32:05.064839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:32:05.064839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:32:05.064839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:05.066234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:05.072103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:05.112467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f406ab-a0fb-4da3-98f8-a7f7d3ca4bbc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:05.147003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:05.147642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:05.147925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:05.148320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:05.149545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:05.151040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:05.153552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:05.159486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:05.181055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad090-7f0a-4f62-8920-98613f38d588 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:05.184126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:05.189470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:05.216527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:05.217137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:05.217423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:05.217689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:05.218373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:05.218658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:05.220052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498522d-5314-4a9b-9f5a-a0c4d6ec8307 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:05.238658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:05.258527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9998d-c676-49ca-a51b-47dbe1542f05 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:05.298901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:05.299537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:05.299818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:05.300091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:05.300831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.domain.id=default, user.id=fb28b21d104a41698326c53a88a850ca) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:05.301139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:05.302636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6507-4aa1-438a-9943-92a29f6b8dcb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:05.312276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 14 02:32:05 2022] GET /identity/v3/role_assignments?user.id=fb28b21d104a41698326c53a88a850ca&scope.domain.id=default&role.id=71e577fde5844b97bf565dd6010625e6 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:07.906765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb9e7-40f7-4eff-9df2-caebcf5d801f None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:07.907263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb9e7-40f7-4eff-9df2-caebcf5d801f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:07.907362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb9e7-40f7-4eff-9df2-caebcf5d801f None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:07.908652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:07.914031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1aa8-7d03-4642-a547-5136c153e3dd None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:07.914904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1aa8-7d03-4642-a547-5136c153e3dd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:07.915400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a1aa8-7d03-4642-a547-5136c153e3dd None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:07.917009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:07.917752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a380-6f27-4ad8-840f-19220567277f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:07.918042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a380-6f27-4ad8-840f-19220567277f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:07.918408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955a380-6f27-4ad8-840f-19220567277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:07.931460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:07.932065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:07.932552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:07.941119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a955a380-6f27-4ad8-840f-19220567277f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:07.942302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a955a380-6f27-4ad8-840f-19220567277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:07.965431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG passlib.handlers.bcrypt [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88132) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 02:32:07.965990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG passlib.handlers.bcrypt [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88132) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 02:32:08.037960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:08.041578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-979d3067-9da7-45c2-9450-7d5ea06aa738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:08.066497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:08.066497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fea7-806c-47ee-84bc-6f0607ff0bc6 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:08.066497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fea7-806c-47ee-84bc-6f0607ff0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:08.066816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5fea7-806c-47ee-84bc-6f0607ff0bc6 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:08.068047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:08.081371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49dd3c-8b50-40d7-aea2-6f0ba3f7183c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:08.081371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49dd3c-8b50-40d7-aea2-6f0ba3f7183c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:08.081855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49dd3c-8b50-40d7-aea2-6f0ba3f7183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:08.115842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-cf49dd3c-8b50-40d7-aea2-6f0ba3f7183c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:08.117031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-cf49dd3c-8b50-40d7-aea2-6f0ba3f7183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:08.199295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:08.242251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:08.598157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d707-3c56-4cc5-ab85-b76a1f4b30f6 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:08.598517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d707-3c56-4cc5-ab85-b76a1f4b30f6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:08.598644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d707-3c56-4cc5-ab85-b76a1f4b30f6 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:08.600009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 14/28] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:08.605388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:08.605702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:08.605985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:08.631461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:08.632652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:08.638165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d707-3c56-4cc5-ab85-b76a1f4b30f6 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:08.675527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:08.675696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:08.760337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 15/29] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:08.761162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:08.786382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d707-3c56-4cc5-ab85-b76a1f4b30f6 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:08.887862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:08.888870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:08.889148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:08.889418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:08.895394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0b9c4-0702-409e-a03e-dad041d7332b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:08.923386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:08.928617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:08.929568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:08.931123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 15/30] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:08.933441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:08.934590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:08.934876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:08.935148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:08.935821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:08.937206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:08.938557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.035390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.050476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf8e9e-8665-4989-a3d7-9d70d33877a2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.112699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.113337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.113843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.114348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.136682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.139377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:32:09.160225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:09.161171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:32:09.161943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:32:09.161943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:32:09.161943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:09.163896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:09.165002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.194512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 16/32] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 14 02:32:08 2022] POST /identity/v3/roles => generated 219 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:09.194512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.232849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.315463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217a6c-28de-44e4-9cbb-2d311782eb42 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.361729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541a64d-e94b-4160-a04e-4561d553fc02 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.370258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.371411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.371960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.372554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.373496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:09.374026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.375827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.384497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.412505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:09.412505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.412765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725451a-4ca5-4d7d-b61d-e4ea49e707a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.412765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725451a-4ca5-4d7d-b61d-e4ea49e707a9 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.412765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725451a-4ca5-4d7d-b61d-e4ea49e707a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.412979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725451a-4ca5-4d7d-b61d-e4ea49e707a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.413610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725451a-4ca5-4d7d-b61d-e4ea49e707a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.415815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725451a-4ca5-4d7d-b61d-e4ea49e707a9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.504976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 17/34] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 14 02:32:09 2022] POST /identity/v3/roles => generated 225 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:09.507239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a075f-8330-48aa-a460-fa06a76907ad None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.507735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a075f-8330-48aa-a460-fa06a76907ad None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.508307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a075f-8330-48aa-a460-fa06a76907ad None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.510782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 18/35] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:09.516102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a075f-8330-48aa-a460-fa06a76907ad None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.522218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed74d67-67ae-4db7-a828-8312eee2eed2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.568366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1c288-a340-45e7-be08-512483322874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.569009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c288-a340-45e7-be08-512483322874 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.569286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c288-a340-45e7-be08-512483322874 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.569556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c288-a340-45e7-be08-512483322874 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.570214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c288-a340-45e7-be08-512483322874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:09.570562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c288-a340-45e7-be08-512483322874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.572035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c288-a340-45e7-be08-512483322874 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.595802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 18/36] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:09.597088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362f3c-34ff-40cc-ab3d-29a70f288c6e None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.597371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362f3c-34ff-40cc-ab3d-29a70f288c6e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.597640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362f3c-34ff-40cc-ab3d-29a70f288c6e None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.600368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 19/37] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:09.600368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96f42-fa7c-498b-866e-097cc44f4f3f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.600580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96f42-fa7c-498b-866e-097cc44f4f3f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.601113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96f42-fa7c-498b-866e-097cc44f4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.617388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.624401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-26f96f42-fa7c-498b-866e-097cc44f4f3f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:09.625889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-26f96f42-fa7c-498b-866e-097cc44f4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:09.646365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a075f-8330-48aa-a460-fa06a76907ad None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.683515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.684161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.684440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.684724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.686637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.688111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.689735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 19/38] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:09 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:09.690495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.696907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.710353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 20/39] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:09.711782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.712862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.712862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.732191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:09.733766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:09.817460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2b94-4081-4b65-ba72-106be4a69df8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.818979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:09.819660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:09.874418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.875432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.876131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.876965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.877828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.880067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.906615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.929752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96058ba8-ac82-4a93-8d0f-b39d5f2105e2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:09.954451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:09.968481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:09.969127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:09.969405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:09.969676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:09.971035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:09.977094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:09.977094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 22/41] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:09.979479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:10.003693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 20/42] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:32:09 2022] POST /identity/v3/projects => generated 301 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:10.011595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:10.097472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8394df-aea7-4610-ba39-760ac788df73 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:10.137463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:10.138400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:10.138899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:10.139001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] PATH_INFO: `/v3/domains/default/users/fb28b21d104a41698326c53a88a850ca/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:10.141286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fb28b21d104a41698326c53a88a850ca, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:10.142789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:10.145098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a8050-06c8-404d-a89b-8c8bfe6356aa None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:10.183962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:10.184616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:10.184904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:10.185184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:10.185897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:10.187403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:10.268419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 21/43] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 14 02:32:10 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:10.269168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:10.342400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 23/44] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Sep 14 02:32:09 2022] PUT /identity/v3/domains/default/users/fb28b21d104a41698326c53a88a850ca/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:32:10.447121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:10.501047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5025ed-16f5-4a78-a5af-e5a311e37091 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:10.541169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f7aae-0ae6-46c7-8188-6010835c371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:10.541748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f7aae-0ae6-46c7-8188-6010835c371b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:10.542032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f7aae-0ae6-46c7-8188-6010835c371b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:10.542310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f7aae-0ae6-46c7-8188-6010835c371b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:10.544089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f7aae-0ae6-46c7-8188-6010835c371b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:10.545533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f7aae-0ae6-46c7-8188-6010835c371b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:10.547385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:10.553229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:10.602619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:10.654019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc858c0-f98e-490c-ad07-35313cde6643 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:10.687356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e7b9-ae24-4f51-87d2-3aa51a856a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:10.687973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e7b9-ae24-4f51-87d2-3aa51a856a65 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:10.688259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e7b9-ae24-4f51-87d2-3aa51a856a65 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:10.688539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e7b9-ae24-4f51-87d2-3aa51a856a65 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:10.689194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e7b9-ae24-4f51-87d2-3aa51a856a65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:10.690894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e7b9-ae24-4f51-87d2-3aa51a856a65 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:10.774261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:32:10 2022] POST /identity/v3/projects => generated 312 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:12.527165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b30d-4532-485f-8362-c56833e9c9d9 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:12.527776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b30d-4532-485f-8362-c56833e9c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:12.527860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b30d-4532-485f-8362-c56833e9c9d9 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:12.529184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:12.534651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe279-16e9-46a4-a6d4-fa66486fbbd1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:12.535028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe279-16e9-46a4-a6d4-fa66486fbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:12.535334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe279-16e9-46a4-a6d4-fa66486fbbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:12.554826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-84dbe279-16e9-46a4-a6d4-fa66486fbbd1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:12.556373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-84dbe279-16e9-46a4-a6d4-fa66486fbbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:12.727571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:12.947935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f977b-76c1-418a-9e97-3e541d16b406 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:12.948223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f977b-76c1-418a-9e97-3e541d16b406 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:12.948499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f977b-76c1-418a-9e97-3e541d16b406 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:12.950440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 24/49] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:12.955700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:12.955991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:12.956265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:12.974669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:12.975849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:12.997002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f977b-76c1-418a-9e97-3e541d16b406 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:12.999469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:13.041231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 26/50] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:13.101305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f977b-76c1-418a-9e97-3e541d16b406 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.124919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:13.135960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.136592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.137430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.137707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.148811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:13.156129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:13.156981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:13.157719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 25/51] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:13.163232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:13.259109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fd642-63f5-42b2-bd4a-a82dc7014ca2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.290982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.291584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.291863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.292138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.292803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:13.293656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:13.295140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:13.303022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 27/52] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:13.308699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:13.312016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:13.335554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:13.408334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c17a09-6d76-4f07-af44-0503ced0ee8f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.410636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51ddbe-8595-4bc5-9aaa-713f8204c5ab None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.441813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.442434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.442813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.443085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.444200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.444327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:13.444834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.445120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.445399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.445647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:13.446576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:13.447255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:13 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:13.448017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:13.450134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:13.453099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:13.455420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:13.503596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:13.547419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:13.556368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faed9-7739-4b6b-a17d-d86a6bdd96ed None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.557920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ca19-1ad8-44c8-b906-1845c2d55c85 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.590599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.591238 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.591516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.591791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.592915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81d974-22a7-4a85-b846-f0f97c4b64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.593026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:13.593530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d974-22a7-4a85-b846-f0f97c4b64ef None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.593815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d974-22a7-4a85-b846-f0f97c4b64ef None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.594091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81d974-22a7-4a85-b846-f0f97c4b64ef None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.594391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:13.594772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81d974-22a7-4a85-b846-f0f97c4b64ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:13.596001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:13.596214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81d974-22a7-4a85-b846-f0f97c4b64ef None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:13.601784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:13.682937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 29/56] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 14 02:32:13 2022] POST /identity/v3/projects => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:32:13.701457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264e35-a07b-4f8f-b8c3-f6e11614e592 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:13.721112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:13.739337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:13.739980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:13.740266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:13.740545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:13.741305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.domain.id=default, user.id=fb28b21d104a41698326c53a88a850ca) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:13.741622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:13.743212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ea8a-706b-4b4d-b63a-886e360a224a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:13.751818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Sep 14 02:32:13 2022] GET /identity/v3/role_assignments?user.id=fb28b21d104a41698326c53a88a850ca&scope.domain.id=default&role.id=71e577fde5844b97bf565dd6010625e6 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:15.850538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f038d-affd-44a8-9fcc-4ef92a00c210 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:15.851085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f038d-affd-44a8-9fcc-4ef92a00c210 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:15.851085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f038d-affd-44a8-9fcc-4ef92a00c210 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:15.852460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:15.857756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:15.858143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:15.858312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:15.880731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:15.882285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:15.948446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:16.221095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f038d-affd-44a8-9fcc-4ef92a00c210 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:16.318619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f038d-affd-44a8-9fcc-4ef92a00c210 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:16.351247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f79b12-1ece-4cf5-a5e1-53d655b9ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:16.351862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79b12-1ece-4cf5-a5e1-53d655b9ca7c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:16.352141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79b12-1ece-4cf5-a5e1-53d655b9ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:16.352416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79b12-1ece-4cf5-a5e1-53d655b9ca7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:16.353637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f79b12-1ece-4cf5-a5e1-53d655b9ca7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:16.355102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f79b12-1ece-4cf5-a5e1-53d655b9ca7c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:16.356676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:16.362088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:16.457419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b678d69-0285-42c8-9ac4-0af7e097343d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:16.469898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:16.490706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6a6cf-8bbb-4013-b594-48ab82c8c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:16.491240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6a6cf-8bbb-4013-b594-48ab82c8c9ec None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:16.491518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6a6cf-8bbb-4013-b594-48ab82c8c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:16.491795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6a6cf-8bbb-4013-b594-48ab82c8c9ec None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:16.492435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6a6cf-8bbb-4013-b594-48ab82c8c9ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:16.493890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6a6cf-8bbb-4013-b594-48ab82c8c9ec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:16.578254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:16 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:19.993310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4026d-c3bf-4911-99cf-46167d07187a None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:19.994317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4026d-c3bf-4911-99cf-46167d07187a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:19.994858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4026d-c3bf-4911-99cf-46167d07187a None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:19.996863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:20.002066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07d63b-7829-4913-9055-ef8b28531f53 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.002983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07d63b-7829-4913-9055-ef8b28531f53 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.003349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07d63b-7829-4913-9055-ef8b28531f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.010326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0408f-676e-4a26-9e75-1c7832f18aee None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.010897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0408f-676e-4a26-9e75-1c7832f18aee None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.011368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0408f-676e-4a26-9e75-1c7832f18aee None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.013742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 33/63] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:20.018965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fe772-1a2c-4a8c-a052-4f177018e9dc None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.019529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fe772-1a2c-4a8c-a052-4f177018e9dc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.020122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fe772-1a2c-4a8c-a052-4f177018e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.029488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-dd07d63b-7829-4913-9055-ef8b28531f53 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:20.030730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-dd07d63b-7829-4913-9055-ef8b28531f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:20.053871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-760fe772-1a2c-4a8c-a052-4f177018e9dc None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:20.055129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-760fe772-1a2c-4a8c-a052-4f177018e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:20.058292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:20.123515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 31/64] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:20.125039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2ab0-66bb-44fb-a70f-cbe74ad483f6 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.125565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2ab0-66bb-44fb-a70f-cbe74ad483f6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.125983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2ab0-66bb-44fb-a70f-cbe74ad483f6 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.127483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 32/65] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:20.146264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13e99-943d-48f5-bc67-6515e7f9ce06 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.146806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13e99-943d-48f5-bc67-6515e7f9ce06 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.147223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13e99-943d-48f5-bc67-6515e7f9ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.166355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 34/66] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:20.172827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a8d13e99-943d-48f5-bc67-6515e7f9ce06 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:20.174179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a8d13e99-943d-48f5-bc67-6515e7f9ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:20.245550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 33/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:20.462446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af93ab-c681-415b-a233-86387d790b39 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.463138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af93ab-c681-415b-a233-86387d790b39 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.463646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af93ab-c681-415b-a233-86387d790b39 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.466393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 35/68] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:20.471218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686955-d350-41da-8edc-1ac644058eae None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.471739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686955-d350-41da-8edc-1ac644058eae None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.472208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686955-d350-41da-8edc-1ac644058eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.478385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af93ab-c681-415b-a233-86387d790b39 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:20.507137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d6686955-d350-41da-8edc-1ac644058eae None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:20.508840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d6686955-d350-41da-8edc-1ac644058eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:20.537800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:20.588871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 34/69] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:20.590801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686955-d350-41da-8edc-1ac644058eae None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:20.608808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af93ab-c681-415b-a233-86387d790b39 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:20.657290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:20.657949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.658231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.658913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.668413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:20.672070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:20.677882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:20.683460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 36/70] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:20.684786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:20.714901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686955-d350-41da-8edc-1ac644058eae None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:20.751583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:20.752218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.752500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.752772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.764913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:20.769724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:20.770611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:20.771352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:20.771973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:20.793594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:20.810825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab747bf-b07e-43af-9f75-915dcacef383 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:20.845810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17a07f-bc46-4b17-8439-59ae7803e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:20.846444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17a07f-bc46-4b17-8439-59ae7803e115 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.846755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17a07f-bc46-4b17-8439-59ae7803e115 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.847028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17a07f-bc46-4b17-8439-59ae7803e115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.857786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17a07f-bc46-4b17-8439-59ae7803e115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-4c17a07f-bc46-4b17-8439-59ae7803e115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:20.862681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:20.863512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:20.864296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 37/72] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:20.865792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845fba-7305-4711-a8c7-cd08e8539231 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.865792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845fba-7305-4711-a8c7-cd08e8539231 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.865792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845fba-7305-4711-a8c7-cd08e8539231 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.868638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 38/73] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:20.868638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845fba-7305-4711-a8c7-cd08e8539231 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:20.880860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6cd1c-167a-4544-bfcb-3a06ebf701bf None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:20.916109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:20.916794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:20.917072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:20.917351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:20.918057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:20.918525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:20.919920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:20.930450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:20.936064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 36/74] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:20.936064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:20.978198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845fba-7305-4711-a8c7-cd08e8539231 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.012279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.012889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.013431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.013560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.013925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.014365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:21.014702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.016150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7d58-3567-492c-b20b-172ce29e9050 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.024313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 39/75] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.029114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.029114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.029114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.036620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252f71-b819-406b-ac4d-e83bc4b7984f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.044470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:21.045657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:21.070639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.071244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.071522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.071805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.072464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:21.072766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.074180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.082222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 37/76] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:32:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.082989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.114580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 40/77] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:21.119433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.178584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.191111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d5d6a-d9c1-4b4b-9006-fed632623104 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.225785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d66fd-b78f-469f-9789-5fdeb85981e5 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.226047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.226647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.226933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.227211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.238000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:21.243354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:21.244194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 38/78] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:21.245386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.248084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.268295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.269061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.269296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.269568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.270735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.272184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.274015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 41/79] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.275704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.352291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7967-cd5c-4efb-8b6c-57cb7cae22fe None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.385486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaadb7-9f2f-4b0e-986b-223994f6e55f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.385723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.386363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.386765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.387227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.406717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.407151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.408273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.409974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 39/80] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.410763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.421376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.422129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.422287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.422577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.423737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.425168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.426896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.427512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.474104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.513451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4a43-b4a8-4271-a11b-4163422ff43e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.525203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e413fb-5b06-4708-bb1f-6f1a05be4295 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.546198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.546827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.547111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.547381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.548034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] RBAC: Adding query filter params (name=member) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:21.548337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.549697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.557508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 40/82] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.557949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.558280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.558668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.558960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.559244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.615819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.628449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.629954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.660370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b5eea-cd90-489a-8f41-81bfddc9c63b None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.682206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.694803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.695438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.695722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.696002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.697281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.698653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.700824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 41/83] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:21.701959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.732422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 43/84] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:21.733262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:21.804893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a3fe-1ba7-4214-8fbd-6663a445bf43 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.819246 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.830600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f556-360f-474d-a302-2bc4ddc75193 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:21.839519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.840629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.840912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.841178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.864958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:21.865594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:21.865875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:21.866156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:21.898380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:21.910029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.911540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:21.935246 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:21.936702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.016584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 42/85] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:22.021661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.022089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.034187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 44/86] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:22.038148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.108867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.117966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d23d-14a2-4052-ae68-61ec002623cc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.137450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e8182-e39c-44f9-a1c6-cb21b9fd0d7c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.151847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.153410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.153700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.153975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.155134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.156587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.158395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 43/87] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:22.159032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.176532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.177145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.177429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.177709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.178365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.179830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.257122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df51bf7-d3d8-403b-9da6-b30ba32d0218 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.270019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 45/88] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:22 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:22.270019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.297344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.298008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.298292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.298661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.299826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.301426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.308354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 44/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:22.308354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.338596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.339644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.408133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e63fc-1cb0-4bd1-a7cf-21017aeb2a55 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.421329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccbf31-4998-4eb0-802f-b49c09ff2a15 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.454057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.454916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.455513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.455799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.457088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.458568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.460437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:22.460999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.462099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.463729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.463729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.463729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.464755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.467059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.468837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 45/91] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:22.469469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.587619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.592980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ac0ba-9891-4445-b910-73f244f7e6fa None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.597028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddfacf-9b0b-4cfc-9854-c2efcf52e6de None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.606330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.629564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.631295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.631295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.631480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.640772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.641478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.641581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.643302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.643302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=fb28b21d104a41698326c53a88a850ca) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:22.643302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.644294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.651044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 46/92] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/role_assignments?user.id=fb28b21d104a41698326c53a88a850ca&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:22.653138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.725971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.728438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.803627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24b083-95bc-44be-ad5f-d697e641f1cc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:22.872243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:22.872786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:22.873066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:22.873340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:22.874075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=aab64679c18c462da84c42e8980f7579) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:22.874387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:22.875861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:22.883917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 47/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/role_assignments?user.id=aab64679c18c462da84c42e8980f7579&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:22.885062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:22.932361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:22.965386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 47/94] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:22.971252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:23.001424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:23.043971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d8b9-5c7d-458b-a41b-82bd0bb5f373 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:23.116797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:23.117409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:23.117687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:23.117961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:23.121176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] RBAC: Adding query filter params (role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=aab64679c18c462da84c42e8980f7579) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:23.121496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:23.123055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:23.136135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 48/95] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/role_assignments?user.id=aab64679c18c462da84c42e8980f7579&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=9108424240854e83b07bba15a59c1a63 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:23.177188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b50d9c-91fc-4f60-bd23-57c2cfb33738 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:23.233304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a3465-5c6a-4be2-9088-7dba0652dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:23.233952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3465-5c6a-4be2-9088-7dba0652dd71 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:23.234233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3465-5c6a-4be2-9088-7dba0652dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:23.234588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3465-5c6a-4be2-9088-7dba0652dd71 None admin] PATH_INFO: `/v3/projects/005aa75456314ad18f19c99dfeda6ce6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:23.239245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a3465-5c6a-4be2-9088-7dba0652dd71 None admin] RBAC: Authorizing `identity:get_project(project_id=005aa75456314ad18f19c99dfeda6ce6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:23.240727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a3465-5c6a-4be2-9088-7dba0652dd71 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:23.242856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 48/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:22 2022] GET /identity/v3/projects/005aa75456314ad18f19c99dfeda6ce6 => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:23.248827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:23.374185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:23.390771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04308a6c-0882-4467-a1de-2504f6912f36 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:23.435014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:23.436041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:23.436321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:23.436596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:23.437333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=005aa75456314ad18f19c99dfeda6ce6, user.id=aab64679c18c462da84c42e8980f7579) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:23.437644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:23.439134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db0ce6-2ff3-4f5f-bcdd-a048b89e87aa None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:23.445337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 49/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:23 2022] GET /identity/v3/role_assignments?user.id=aab64679c18c462da84c42e8980f7579&scope.project.id=005aa75456314ad18f19c99dfeda6ce6&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:25.333190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4515-8095-41bc-a3c0-5c67608fa271 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:25.334122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4515-8095-41bc-a3c0-5c67608fa271 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:25.334565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e4515-8095-41bc-a3c0-5c67608fa271 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:25.336318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 49/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:25.348450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea830-e915-4779-a3c0-a0d8a5b28164 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:25.349286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea830-e915-4779-a3c0-a0d8a5b28164 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:25.349722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea830-e915-4779-a3c0-a0d8a5b28164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:25.379459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6bdea830-e915-4779-a3c0-a0d8a5b28164 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:25.380882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6bdea830-e915-4779-a3c0-a0d8a5b28164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:25.465178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 50/99] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:25.765698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e339c-18b6-4ed0-99bc-0de084511ac4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:25.766376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e339c-18b6-4ed0-99bc-0de084511ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:25.766938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e339c-18b6-4ed0-99bc-0de084511ac4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:25.768590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 50/100] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:25.774206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:25.774779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:25.775254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:25.799715 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:25.800400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df077-33dd-4360-b242-1547e278860c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:25.800871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df077-33dd-4360-b242-1547e278860c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:25.801801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:25.801908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df077-33dd-4360-b242-1547e278860c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:25.803054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 51/101] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:25.809023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2b4d-bd95-4fab-881b-e41b0c7423cd None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:25.809586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2b4d-bd95-4fab-881b-e41b0c7423cd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:25.810054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2b4d-bd95-4fab-881b-e41b0c7423cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:25.829119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9add2b4d-bd95-4fab-881b-e41b0c7423cd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:25.839591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9add2b4d-bd95-4fab-881b-e41b0c7423cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:25.907801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 52/102] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:25.940001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 51/103] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:26.007185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98f49-4f2d-4f38-9db5-166cdf246cb9 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.007497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98f49-4f2d-4f38-9db5-166cdf246cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.007738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98f49-4f2d-4f38-9db5-166cdf246cb9 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.009097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 53/104] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:26.016501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.019730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.020134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.020411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.031824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:26.050900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:26.052091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:26.055385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:26.179784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d279cf-b215-49fc-a284-916a9ee1a074 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.215541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 54/105] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:26.240546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.241200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.241483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.241758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.256327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:26.261278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:26.262690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:26.263733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 52/106] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:26.270752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.320508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.418734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34727ce0-4805-4e5c-a800-dd80acb8d070 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.454082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:26.477463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.478109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.478392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.478697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.479397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:26.479708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:26.481425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:26.499307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 55/107] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:26.500680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.510848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:26.532217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7dbe-436a-4518-a4f1-5fa0dc4ea3bb None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.596679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.597333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.597614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.597884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.615895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:26.621909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:26.623053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 53/108] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:26.627682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.657680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7941b-3e48-46b5-8961-45df3211acc7 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.693876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.694538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.694823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.695097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.707178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:26.713075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:26.713965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:26.714835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 56/109] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:26.715556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.732332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dc423-6e90-4c31-91e5-f0e3cead885e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.765779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:26.771735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e046f8f-4f76-41f9-afa1-fac1d214816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.772429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e046f8f-4f76-41f9-afa1-fac1d214816f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.772712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e046f8f-4f76-41f9-afa1-fac1d214816f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.772982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e046f8f-4f76-41f9-afa1-fac1d214816f None admin] PATH_INFO: `/v3/users/e5b6823428f24019bb90905ba7707db5` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.782553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:26.786943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e046f8f-4f76-41f9-afa1-fac1d214816f None admin] RBAC: Authorizing `identity:get_user(user_id=e5b6823428f24019bb90905ba7707db5)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:26.788392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e046f8f-4f76-41f9-afa1-fac1d214816f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:26.794729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 54/110] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/users/e5b6823428f24019bb90905ba7707db5 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:26.794729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b50c-59b7-40e0-a908-fa82c74f1be9 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.794729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b50c-59b7-40e0-a908-fa82c74f1be9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.794729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b50c-59b7-40e0-a908-fa82c74f1be9 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.797841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 55/111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:26.798737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b50c-59b7-40e0-a908-fa82c74f1be9 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.833860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c84216-3519-460b-828c-e8f30a359588 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.871756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.872426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.872712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.872987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.874221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:26.875752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:26.877786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 57/112] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:26.880426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.914328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b50c-59b7-40e0-a908-fa82c74f1be9 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:26.948759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:26.949993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:26.950516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:26.950857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:26.951531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:26.951834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:26.953215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:26.962122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 56/113] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:26.967472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:26.995218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9bae6-b383-4e55-84b7-f7a68f0aef9e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.017115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.023714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.030436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.031412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.031887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.032352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.033515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:27.033982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.036183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30bd1-7d36-4bf8-8307-63f14f7e27f2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.054249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 58/114] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:27.054249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.054249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.054249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.079722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:27.081032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:27.092130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c4e1b-e33a-4289-b10f-12260ed0f220 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.125222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.125826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.126132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.126407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.148919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 59/115] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:27.149823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.212180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.213683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.252553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a6692-0da4-48b5-8e4d-97e90cad090a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.263765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.278242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.291155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54f7f-2112-44c2-ac5c-54906a2606d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.291706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54f7f-2112-44c2-ac5c-54906a2606d9 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.291989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54f7f-2112-44c2-ac5c-54906a2606d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.292273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54f7f-2112-44c2-ac5c-54906a2606d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.293628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54f7f-2112-44c2-ac5c-54906a2606d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.295859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54f7f-2112-44c2-ac5c-54906a2606d9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.314803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 57/116] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:27.315653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.375258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 60/117] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:32:27 2022] POST /identity/v3/projects => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:27.376338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376af67-a2ed-4c3a-8760-2c965938b595 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.376705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376af67-a2ed-4c3a-8760-2c965938b595 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.376989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376af67-a2ed-4c3a-8760-2c965938b595 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.378535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 61/118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:27.379377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376af67-a2ed-4c3a-8760-2c965938b595 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.429197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dbe76-f211-4a6c-8e04-acea413938f0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.467343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.467987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.468268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.468540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.469772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.471316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.473153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 58/119] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:27.473844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.494443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.505347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376af67-a2ed-4c3a-8760-2c965938b595 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.546908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf666-39cd-4e45-bac4-80eae2fa4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.547469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf666-39cd-4e45-bac4-80eae2fa4053 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.547753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf666-39cd-4e45-bac4-80eae2fa4053 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.548033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf666-39cd-4e45-bac4-80eae2fa4053 None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.549190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf666-39cd-4e45-bac4-80eae2fa4053 None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.550695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf666-39cd-4e45-bac4-80eae2fa4053 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.552327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 62/120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:27.553498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.553740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.554011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.572466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:27.573667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:27.596468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4540f0-706b-48f0-ad03-7a390df1c31f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.615957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.637656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.638573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.638859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.639133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.640564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.641910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.648492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 59/121] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:27.648492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.660465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 63/122] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:27.661322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.762541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.766936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94936b5e-3e47-4209-b475-40b432f4a914 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.782386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449cb23-6095-49ce-b742-670bd034d606 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.805128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.805688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.805965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.806235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.807382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.809614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.811363 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 64/123] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:27.815774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.824599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.825431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.826272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.826753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.843733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:27.848891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:27.849945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 60/124] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:27.850795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:27.876765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:27.942693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a4d3-fa99-4ed5-86d2-2f5061115b0b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.980223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:27.980488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba31f-861c-4df8-923a-18331f55e470 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:27.980965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:27.981243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:27.981512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:27.982666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:27.984091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:27.985726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 65/125] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:27.990804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.017024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.017646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.017900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.018167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.018917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] RBAC: Adding query filter params (role.id=210f589e6d3944a892f48ee49eaa7cd3, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=e5b6823428f24019bb90905ba7707db5) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:28.019226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:28.020663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:28.026188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 61/126] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:27 2022] GET /identity/v3/role_assignments?user.id=e5b6823428f24019bb90905ba7707db5&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=210f589e6d3944a892f48ee49eaa7cd3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:28.026891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.041184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:28.139170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d605dd-b0f2-461f-92e2-91120a20b6bb None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:28.150817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:28.178636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d2fa9-08c2-4c90-b679-79d7f9cdcaa5 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:28.187047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.188281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.188791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.189260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/fb28b21d104a41698326c53a88a850ca/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.191761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] RBAC: Authorizing `identity:create_grant(project_id=a28ef57275424d4ba1cf73e79fb16d45, user_id=fb28b21d104a41698326c53a88a850ca, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:28.193792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:28.218485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.219152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.219436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.219710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.220375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:28.220680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:28.222058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:28.231471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 62/127] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:32:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:28.232102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.270509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 66/128] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:27 2022] PUT /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/fb28b21d104a41698326c53a88a850ca/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:28.271837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.368823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:28.434324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f7ddc-82c4-4f89-b26b-319dac698e7a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:28.488902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee21bbc-37ac-4d60-8b71-eb7062f0eb6e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:28.498057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.498738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.499064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.499291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.514371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:28.521880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:28.522778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:28.523539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 63/129] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:28.528692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.544752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.545433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.545718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.545995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/aab64679c18c462da84c42e8980f7579/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.548277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28ef57275424d4ba1cf73e79fb16d45, user_id=aab64679c18c462da84c42e8980f7579, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:28.551467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:28.645933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc04661-89ff-4300-979e-afa9f72c08f7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:28.656727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 67/130] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:28 2022] PUT /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/aab64679c18c462da84c42e8980f7579/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:28.658744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.699665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:28.712182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:28.721077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.721803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.722085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.722357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.727281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:28.728777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:28.730574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 64/131] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:28 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:28.738446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.834798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db17379-a0b1-4cb3-a1a8-0e79cc2e4493 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:28.919400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:28.919957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:28.920288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:28.920562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:28.921250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:28.921551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:28.922978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:28.934837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 68/132] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:28.941360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:28.958132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9053d8e-767f-4924-bef6-41ec47bbdfcb None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:29.051745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:29.052464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.052688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.052973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.054142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:29.055712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:29.057285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 65/133] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:28 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:29.067403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:29.073151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:29.085869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fb14-7a5f-4591-9b73-bec77b00b454 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:29.163176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:29.164179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.164655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.165146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.167199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:29.169546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:29.171401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 69/134] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:28 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:29.177004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:29.226429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:29.290503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee946e3-788f-44e4-be54-d9cba89469c9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:29.324935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdce03-245a-4ca4-8f14-41d84df0810f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:29.349983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53fea3-7755-496d-a1d5-bb85a3f0336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:29.350697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fea3-7755-496d-a1d5-bb85a3f0336e None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.350986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fea3-7755-496d-a1d5-bb85a3f0336e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.351269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fea3-7755-496d-a1d5-bb85a3f0336e None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/aab64679c18c462da84c42e8980f7579/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.353476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53fea3-7755-496d-a1d5-bb85a3f0336e None admin] RBAC: Authorizing `identity:create_grant(project_id=a28ef57275424d4ba1cf73e79fb16d45, user_id=aab64679c18c462da84c42e8980f7579, role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:29.359171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53fea3-7755-496d-a1d5-bb85a3f0336e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:29.367150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:29.368119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.368595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.369058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] PATH_INFO: `/v3/projects/005aa75456314ad18f19c99dfeda6ce6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.371450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] RBAC: Authorizing `identity:get_project(project_id=005aa75456314ad18f19c99dfeda6ce6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:29.373247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:29.375617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 70/135] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:29 2022] GET /identity/v3/projects/005aa75456314ad18f19c99dfeda6ce6 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:29.383388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:29.426431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:29.450575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 66/136] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:29 2022] PUT /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/aab64679c18c462da84c42e8980f7579/roles/9108424240854e83b07bba15a59c1a63 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:29.510257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3919e7-d05c-4351-896a-c460792a97f6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:29.551551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339b034-ba01-40e2-b65d-25cb4a3ad29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:29.552287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339b034-ba01-40e2-b65d-25cb4a3ad29d None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.552511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339b034-ba01-40e2-b65d-25cb4a3ad29d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.552793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339b034-ba01-40e2-b65d-25cb4a3ad29d None admin] PATH_INFO: `/v3/projects/005aa75456314ad18f19c99dfeda6ce6/users/aab64679c18c462da84c42e8980f7579/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.554928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339b034-ba01-40e2-b65d-25cb4a3ad29d None admin] RBAC: Authorizing `identity:create_grant(project_id=005aa75456314ad18f19c99dfeda6ce6, user_id=aab64679c18c462da84c42e8980f7579, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:29.556448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339b034-ba01-40e2-b65d-25cb4a3ad29d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:29.673161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 71/137] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:29 2022] PUT /identity/v3/projects/005aa75456314ad18f19c99dfeda6ce6/users/aab64679c18c462da84c42e8980f7579/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:29.945372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3b96-59b6-4f35-8ab4-f055dba0a2fc None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.945892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3b96-59b6-4f35-8ab4-f055dba0a2fc None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.945964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3b96-59b6-4f35-8ab4-f055dba0a2fc None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.947719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 67/138] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:29.954261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:29.954581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:29.954867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:29.983680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:29.984908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:30.063887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 72/139] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:30.407642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef3b96-59b6-4f35-8ab4-f055dba0a2fc None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:30.523466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef3b96-59b6-4f35-8ab4-f055dba0a2fc None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:30.561363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:30.569207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602b799-4a90-45c1-b11b-27129a099851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:30.569853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b799-4a90-45c1-b11b-27129a099851 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:30.570143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b799-4a90-45c1-b11b-27129a099851 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:30.570419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b799-4a90-45c1-b11b-27129a099851 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:30.571564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602b799-4a90-45c1-b11b-27129a099851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:30.573023 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602b799-4a90-45c1-b11b-27129a099851 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:30.575174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 68/140] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:30.589006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:30.610202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:30.723553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e430fb5-40f3-4087-bd1b-d83df34409a8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:30.769668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db779f-17e2-4835-ac15-8816d7fd793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:30.770288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db779f-17e2-4835-ac15-8816d7fd793b None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:30.770607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db779f-17e2-4835-ac15-8816d7fd793b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:30.770889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db779f-17e2-4835-ac15-8816d7fd793b None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:30.771548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db779f-17e2-4835-ac15-8816d7fd793b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:30.772980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db779f-17e2-4835-ac15-8816d7fd793b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:30.891620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 73/141] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:30 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:31.127369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a938f86-70e0-4300-a9f2-49f523f6fce6 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.127869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a938f86-70e0-4300-a9f2-49f523f6fce6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.128049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a938f86-70e0-4300-a9f2-49f523f6fce6 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.129260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 69/142] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:31.137814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d4d-a5bc-4f7a-a80a-ae2d37601177 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.138663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d4d-a5bc-4f7a-a80a-ae2d37601177 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.139143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d4d-a5bc-4f7a-a80a-ae2d37601177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.163495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-83fa1d4d-a5bc-4f7a-a80a-ae2d37601177 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:31.165118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-83fa1d4d-a5bc-4f7a-a80a-ae2d37601177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:31.259830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 74/143] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:31.662866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f676-65df-4903-99bd-94200d891e15 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.663231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f676-65df-4903-99bd-94200d891e15 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.663434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f676-65df-4903-99bd-94200d891e15 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.664799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 70/144] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:31.670441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707f4e-f152-4158-b821-a2d3553676ec None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.670900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707f4e-f152-4158-b821-a2d3553676ec None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.671075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707f4e-f152-4158-b821-a2d3553676ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.678585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:31.696087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-45707f4e-f152-4158-b821-a2d3553676ec None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:31.699867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-45707f4e-f152-4158-b821-a2d3553676ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:31.704178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f676-65df-4903-99bd-94200d891e15 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:31.790436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 75/145] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:31.792099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ca2a-c576-43fb-b8b8-a2331d3cb17d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.792776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ca2a-c576-43fb-b8b8-a2331d3cb17d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.793301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ca2a-c576-43fb-b8b8-a2331d3cb17d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.795065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 76/146] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:31.800564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.801099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.801573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.827310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:31.828849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:31.847293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f676-65df-4903-99bd-94200d891e15 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:31.887996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:31.888942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:31.889221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:31.889491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:31.902104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:31.908579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:31.909446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:31.910214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 71/147] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:31.915872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:31.948729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 77/148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:31.984739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:32.032691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf63ded-1729-4ceb-8ea4-3e1f5757eea8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.068369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.068984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.069262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.069534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.070204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:32.070540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:32.072017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:32.081265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 72/149] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:32.089374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.157733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:32.204241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d5f0b-054c-4be0-a66c-9a50fa9d8577 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.239380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.264400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.265060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.265343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.265616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] PATH_INFO: `/v3/users/e5b6823428f24019bb90905ba7707db5` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.267350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] RBAC: Authorizing `identity:get_user(user_id=e5b6823428f24019bb90905ba7707db5)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:32.269627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:32.280722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 78/150] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:32 2022] GET /identity/v3/users/e5b6823428f24019bb90905ba7707db5 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:32.286729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.381254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ff008-b652-48a1-83cd-705a157ee699 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.400788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:32.419498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.420567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.421045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.421546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.434370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:32.440520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:32.441360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:32.442142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:32.444467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 73/151] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:32.453367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.556584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66ae3-2e8d-4a90-83dc-bfacd3c5537f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.576157 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c63fe-abfe-4eb8-9ec8-e32dbbb52b87 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.617194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.617911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:32.619368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.619871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.620364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.621956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:32.622661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:32.624348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:32.633545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 74/152] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:32.634687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.635887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.640493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.640999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.641469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.644683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:32.646416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:32.648321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 79/153] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:32 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:32.649258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.715796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:32.787444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec03995-7b59-4b3b-8524-9a0bf73967ee None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.813336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117e23-d006-4818-92a3-96fc8e9a94a9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:32.840399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abe5a6-8177-4c1c-9727-7b7ab68c4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.841478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abe5a6-8177-4c1c-9727-7b7ab68c4561 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.841935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abe5a6-8177-4c1c-9727-7b7ab68c4561 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.842399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abe5a6-8177-4c1c-9727-7b7ab68c4561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.854522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abe5a6-8177-4c1c-9727-7b7ab68c4561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-71abe5a6-8177-4c1c-9727-7b7ab68c4561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:32.861785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:32.862748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:32.863521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:32.865541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 75/154] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:32.867181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120f3b6-d76e-4939-9a6f-3e89915e46c7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.867624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120f3b6-d76e-4939-9a6f-3e89915e46c7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.868099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120f3b6-d76e-4939-9a6f-3e89915e46c7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.870030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 76/155] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:32.871062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120f3b6-d76e-4939-9a6f-3e89915e46c7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:32.903559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9493-7be1-44bb-bb90-af3ff97c1364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:32.904290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9493-7be1-44bb-bb90-af3ff97c1364 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.904564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9493-7be1-44bb-bb90-af3ff97c1364 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.905132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9493-7be1-44bb-bb90-af3ff97c1364 None admin] PATH_INFO: `/v3/users/fb28b21d104a41698326c53a88a850ca` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.910938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9493-7be1-44bb-bb90-af3ff97c1364 None admin] RBAC: Authorizing `identity:get_user(user_id=fb28b21d104a41698326c53a88a850ca)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:32.912625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9493-7be1-44bb-bb90-af3ff97c1364 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:32.914430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 80/156] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:32 2022] GET /identity/v3/users/fb28b21d104a41698326c53a88a850ca => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:32.915536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:32.915819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:32.916089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:32.947490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:32.948697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:32.988736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:32.993621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120f3b6-d76e-4939-9a6f-3e89915e46c7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:33.033951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:33.035024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:33.035448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:33.035861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/e5b6823428f24019bb90905ba7707db5/roles/210f589e6d3944a892f48ee49eaa7cd3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:33.038304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] RBAC: Authorizing `identity:create_grant(project_id=a28ef57275424d4ba1cf73e79fb16d45, user_id=e5b6823428f24019bb90905ba7707db5, role_id=210f589e6d3944a892f48ee49eaa7cd3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:33.040036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:33.090288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 81/157] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:33.091764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:33.104452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:33.118139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 77/158] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:32 2022] PUT /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/users/e5b6823428f24019bb90905ba7707db5/roles/210f589e6d3944a892f48ee49eaa7cd3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:33.119034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:33.312538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb791472-5376-4c26-8984-a70393e1e00b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:33.355323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:33.356727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:33.357060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:33.357340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:33.358118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:33.358431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:33.359955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:33.369823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 82/159] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:33.377045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:33.440513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df57f-0acf-4348-923c-ebf1d4508ecc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:33.475543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:33.500616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e95f-948c-44f6-9da6-f9c4113fec5f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:33.537601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:33.538292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:33.538614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:33.538889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:33.540050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:33.541556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:33.544265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 83/160] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:33 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:33.549630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:33.564357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6dec5-80df-472e-a183-4c6dc49623b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:33.564983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6dec5-80df-472e-a183-4c6dc49623b9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:33.565256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6dec5-80df-472e-a183-4c6dc49623b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:33.565525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6dec5-80df-472e-a183-4c6dc49623b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:33.670737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6fe29-cf4e-4261-a1af-1313023ce64a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:33.686838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:33.708276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:33.712185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:33.712868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:33.713159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:33.713438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:33.799116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6dec5-80df-472e-a183-4c6dc49623b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:33.801300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6dec5-80df-472e-a183-4c6dc49623b9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:33.805746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:33.807457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:33.950686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 78/161] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:33.951878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f56e98-f0bb-4895-90eb-8b3af39cd275 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:33.952159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f56e98-f0bb-4895-90eb-8b3af39cd275 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:33.952431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f56e98-f0bb-4895-90eb-8b3af39cd275 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:33.958358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 79/162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:33.959144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f56e98-f0bb-4895-90eb-8b3af39cd275 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.053422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 84/163] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 02:32:34.055012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.126453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:34.137323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:34.242765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f56e98-f0bb-4895-90eb-8b3af39cd275 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:34.307474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c187-0ab2-4198-94dd-01d7475daefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:34.309227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c187-0ab2-4198-94dd-01d7475daefd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:34.310010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c187-0ab2-4198-94dd-01d7475daefd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:34.310620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c187-0ab2-4198-94dd-01d7475daefd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:34.325046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c187-0ab2-4198-94dd-01d7475daefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-b336c187-0ab2-4198-94dd-01d7475daefd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:34.331031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:34.332032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:34.332852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:34.335806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 80/164] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:34.337688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:34.338182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:34.338694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:34.352401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4db665-d9f3-40cf-b49c-81e64ae3e194 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:34.358794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:34.361196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:34.440489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 81/165] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:34.441894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.463913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:34.464392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:34.464860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:34.465163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:34.471174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:34.472637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:34.474323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 85/166] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:34 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:34.475123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.568765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:34.660915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1e56-badc-40d0-b569-b5dcd7924dfc None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:34.723640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:34.724821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:34.725491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:34.725971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:34.726694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:34.728768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:34.731264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:34.733900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 82/167] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:34 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:34.734957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.744745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e964581-d546-4772-ab3f-efc1da150d4d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:34.830799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:34.831572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:34.831923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:34.832269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:34.833118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:34.833500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:34.835009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:34.856904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 86/168] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:32:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:34.859099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.862502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fdbf8-f447-47b8-9c03-f9379f0d6c64 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:34.910854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:34.936837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:34.938093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:34.938483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:34.938797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:34.939513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=fb28b21d104a41698326c53a88a850ca) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:34.939826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:34.941330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:34.959869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 83/169] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:34 2022] GET /identity/v3/role_assignments?user.id=fb28b21d104a41698326c53a88a850ca&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:34.960723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:34.993071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693378ec-60c4-4e99-be0b-98ce17cea89d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.041361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:35.042415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.043852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.044333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.045299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=aab64679c18c462da84c42e8980f7579) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:35.045904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:35.047643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:35.059019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 87/170] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:34 2022] GET /identity/v3/role_assignments?user.id=aab64679c18c462da84c42e8980f7579&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:35.060698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:35.103490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:35.226032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b543e-49dd-456c-91e0-4ea0c8957318 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.273081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:35.274153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.274815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.275336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.279291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd13f3-d36a-4791-95b7-949edfbbda9c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.287987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:35.293975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:35.294945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:35.295845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:35.298442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 88/171] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:35.304319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:35.387385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:35.387958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.388244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.388782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.390005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:35.391796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:35.393603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 84/172] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:34 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:35.398891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:35.405112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:35.446747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32f1e6-91a5-4625-ab22-386f57b082c4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.516738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:35.543364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:35.543995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.544281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.544547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.545230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:35.545533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:35.546959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:35.567618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 89/173] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:35.577350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:35.639063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677aae-ade3-494a-a3e8-7b75f898c5f7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.698645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5954-c84a-426c-8010-8b39c9043ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:35.699789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5954-c84a-426c-8010-8b39c9043ef0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.700293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5954-c84a-426c-8010-8b39c9043ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.700779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5954-c84a-426c-8010-8b39c9043ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.809336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817210ac-a99a-4547-9344-1bcff9de491c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.819539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db5954-c84a-426c-8010-8b39c9043ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:35.821471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db5954-c84a-426c-8010-8b39c9043ef0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:35.851226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84276448-e894-44bc-bd40-92de90843afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:35.851869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276448-e894-44bc-bd40-92de90843afa None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.852149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276448-e894-44bc-bd40-92de90843afa None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.852420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276448-e894-44bc-bd40-92de90843afa None admin] PATH_INFO: `/v3/users/aab64679c18c462da84c42e8980f7579` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.853669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84276448-e894-44bc-bd40-92de90843afa None admin] RBAC: Authorizing `identity:get_user(user_id=aab64679c18c462da84c42e8980f7579)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:35.855725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84276448-e894-44bc-bd40-92de90843afa None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:35.861624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 90/174] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:35 2022] GET /identity/v3/users/aab64679c18c462da84c42e8980f7579 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:35.861624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9fe94-bd50-4fd2-ba2b-fc0b2ffc3d9d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.861624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9fe94-bd50-4fd2-ba2b-fc0b2ffc3d9d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.861624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9fe94-bd50-4fd2-ba2b-fc0b2ffc3d9d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.861624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 91/175] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:35.862702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9fe94-bd50-4fd2-ba2b-fc0b2ffc3d9d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:35.875844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:35.897767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:35.958670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 85/176] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 02:32:35.960412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:35.960913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:35.961385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:35.973954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9fe94-bd50-4fd2-ba2b-fc0b2ffc3d9d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:35.994520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:35.996757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:36.009179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b38aff-3a6a-461c-bbd6-171c716b52d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:36.009524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b38aff-3a6a-461c-bbd6-171c716b52d4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.009807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b38aff-3a6a-461c-bbd6-171c716b52d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.010081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b38aff-3a6a-461c-bbd6-171c716b52d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.085022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b38aff-3a6a-461c-bbd6-171c716b52d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:36.086571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b38aff-3a6a-461c-bbd6-171c716b52d4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:36.108580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:36.141459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 86/177] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:36.142393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.235438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 92/178] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:36.236843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e372a-9f36-4d3b-8014-1fcfea7876a8 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.237131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e372a-9f36-4d3b-8014-1fcfea7876a8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.237400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e372a-9f36-4d3b-8014-1fcfea7876a8 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.238728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 93/179] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:36.243358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e372a-9f36-4d3b-8014-1fcfea7876a8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.349320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:36.367971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e372a-9f36-4d3b-8014-1fcfea7876a8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:36.385588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:36.390049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87388a60-79d8-49d3-a8d4-64a6cfb955cf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:36.410715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704acfad-9cd1-42c7-8b1d-1775cc8bd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:36.411713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704acfad-9cd1-42c7-8b1d-1775cc8bd6c6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.412200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704acfad-9cd1-42c7-8b1d-1775cc8bd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.412669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704acfad-9cd1-42c7-8b1d-1775cc8bd6c6 None admin] PATH_INFO: `/v3/projects/005aa75456314ad18f19c99dfeda6ce6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.414050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704acfad-9cd1-42c7-8b1d-1775cc8bd6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=005aa75456314ad18f19c99dfeda6ce6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:36.415719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704acfad-9cd1-42c7-8b1d-1775cc8bd6c6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:36.422745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 94/180] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/projects/005aa75456314ad18f19c99dfeda6ce6 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:36.424255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.424764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.425405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.430231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e4c9b-4476-48f9-8ec2-70bc4a4dc6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:36.430952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e4c9b-4476-48f9-8ec2-70bc4a4dc6ba None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.431281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e4c9b-4476-48f9-8ec2-70bc4a4dc6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.431555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e4c9b-4476-48f9-8ec2-70bc4a4dc6ba None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.432901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e4c9b-4476-48f9-8ec2-70bc4a4dc6ba None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:36.435209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e4c9b-4476-48f9-8ec2-70bc4a4dc6ba None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:36.437328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 87/181] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:36.438550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198987b-e9d6-4230-8d2f-e46dc03369ff None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.438836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198987b-e9d6-4230-8d2f-e46dc03369ff None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.439110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198987b-e9d6-4230-8d2f-e46dc03369ff None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.440396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 88/182] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:36.444504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198987b-e9d6-4230-8d2f-e46dc03369ff None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.451159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:36.452435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:36.538744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 95/183] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:36.540435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.570498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198987b-e9d6-4230-8d2f-e46dc03369ff None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:36.611181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:36.612161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.612647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.613123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.614048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=005aa75456314ad18f19c99dfeda6ce6, user.id=aab64679c18c462da84c42e8980f7579) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:36.614589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:36.616219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd37c9-f269-4d93-a0fd-8af1d39462b8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:36.629103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 89/184] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/role_assignments?user.id=aab64679c18c462da84c42e8980f7579&scope.project.id=005aa75456314ad18f19c99dfeda6ce6&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:36.630861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176f78-864d-4adb-9970-ee4dbd11a594 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.631388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176f78-864d-4adb-9970-ee4dbd11a594 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.631858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176f78-864d-4adb-9970-ee4dbd11a594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.658081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-33176f78-864d-4adb-9970-ee4dbd11a594 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:36.659758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-33176f78-864d-4adb-9970-ee4dbd11a594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:36.665046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4ed3-37f7-4fc0-bed6-e8c6eec198af None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:36.669714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:36.678510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:36.708263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:36.709153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.709584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.710033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.710989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] RBAC: Adding query filter params (role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=aab64679c18c462da84c42e8980f7579) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:36.712015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:36.715087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:36.723153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 96/185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/role_assignments?user.id=aab64679c18c462da84c42e8980f7579&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=9108424240854e83b07bba15a59c1a63 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:36.724608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.741116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 90/186] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:36.746711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d178d-31fc-4b31-928d-deb8463dff8e None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.747191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d178d-31fc-4b31-928d-deb8463dff8e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.753129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d178d-31fc-4b31-928d-deb8463dff8e None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.753129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 91/187] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:36.754754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.755636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.755636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.787557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:36.789061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:36.852871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef73b-e391-4cbc-b87a-eacd2b7cd0a3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:36.892800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:36.893757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:36.894240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:36.894740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:36.913005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:36.921943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:36.922967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:36.923849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 97/188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:36.924498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.928714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 92/189] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:36.931187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:36.979885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.018921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.056140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc5cbc-65de-4b36-a446-7b63d40a50cf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.098778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deeeb7c-0838-4c14-8625-859ffcacae68 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.101502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.102552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.102552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.102743 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.103331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:37.103630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.105001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.119312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 93/190] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:37.120651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.151957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.153120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.153390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.153653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.173637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:37.179226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:37.180106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:37.180911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:37.182040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 98/191] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:37.187756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.257627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccb016-ec07-4605-8da6-ec30ac119def None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.292009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.297790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.298421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.298732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.299014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] PATH_INFO: `/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.300965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.301675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b30a-cbf4-4b43-a8ba-5fcb622f8887 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.314241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] RBAC: Authorizing `identity:get_user(user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.315742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.317384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 94/192] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:37.318148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.340435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.341045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.341323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.341594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.342251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:37.342588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.343962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.351805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 99/193] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:37.352584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.416281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d965d-db98-49e0-8726-6c9631a9d17e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.451593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.452220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.452501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.452772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.453210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41f102-2432-4eab-b1b4-3b22ebb23b0e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.453904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.455403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.456976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 95/194] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:37.456976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.488081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.488741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.489030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.489334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.499781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:37.505030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:37.506082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:37.506944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 100/195] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:37.507613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.518065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.523720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.557928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50bf22-c8b4-412e-a079-834b3d8fb26a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.594077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.594694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.594915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.595185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.607411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12649109-403e-486c-8575-18a36b990bc4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.640597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.641224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.641502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.641775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] PATH_INFO: `/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.642945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] RBAC: Authorizing `identity:get_user(user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.644386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.645972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 101/196] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:37.646739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.662297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.663844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.725398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.733255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:37.750651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81b80-2397-4683-8bbf-68a29fea7dad None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.766256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 96/197] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:37.767113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.784357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.784959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.785233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.785498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.786133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.787583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.889226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac247192-1ae0-47a9-ae1e-329063e04cf9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:37.895159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 102/198] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:37 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:37.895984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.938644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:37.939655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:37.940128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:37.940600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:37.941331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:37.941636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:37.943161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:37.954138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 97/199] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:37.954887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:37.982536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:38.026692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b191679-5cbf-449c-81d3-1efa4d2288ff None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.065748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee392b9c-2098-4736-9b74-cdfcbdd8fd89 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.069004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.069616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.069891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.070158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.080522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:38.114546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.115176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.115453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.115725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.116918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.118296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:38.120254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 98/200] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:38.125614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:38.157556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.159026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:38.247484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:38.257531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60888e-32ed-4e71-aef8-64c99c1c46f2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.285019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 103/201] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:38.285927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:38.305210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.305849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.306549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.306549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] PATH_INFO: `/v3/users/e5b6823428f24019bb90905ba7707db5` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.307593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b6823428f24019bb90905ba7707db5)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.309421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:38.311463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 99/202] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:38 2022] GET /identity/v3/users/e5b6823428f24019bb90905ba7707db5 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:38.311826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:38.338210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:38.414400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccebaf4-6176-4d95-92a2-2e22ce681b0a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.453575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ce1e5-4c3e-4fda-8989-66ae9b3b1689 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.458001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.458715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.459068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.459412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.460216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:38.460598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.463503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:38.471688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 104/203] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:38 2022] GET /identity/v3/role_assignments?user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:38.473029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:38.502163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.502917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.503200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.503475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.504726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.506226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:38.514829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 100/204] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:38 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:38.521756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:38.566427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:38.668964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541806-8ba8-4345-affe-fe7288663e6f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.692163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf52d-ecc5-4d24-bb47-d947af740965 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:38.696434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:38.729618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.730897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.731318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.731596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.732322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] RBAC: Adding query filter params (role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:38.732628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.734074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:38.744535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 101/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:38 2022] GET /identity/v3/role_assignments?user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=9108424240854e83b07bba15a59c1a63 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:38.767306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:38.767959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:38.768238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:38.768510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:38.910268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:38.911872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:39.026609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 105/206] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:39.032438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:39.189101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:39.198377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bcf4a-d7b1-46d8-8f1c-2babdbec98e8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:39.243147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc363512-2af1-4a0a-8425-99b140451841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:39.243772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363512-2af1-4a0a-8425-99b140451841 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:39.244045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363512-2af1-4a0a-8425-99b140451841 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:39.244311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363512-2af1-4a0a-8425-99b140451841 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:39.247186 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc363512-2af1-4a0a-8425-99b140451841 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:39.248866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc363512-2af1-4a0a-8425-99b140451841 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:39.251088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 102/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:39 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:39.256625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:39.259273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:39.366635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058cbc1-9549-4618-8e62-b58a3f399fad None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:39.402586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:39.403566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:39.404038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:39.404529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:39.405442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] RBAC: Adding query filter params (role.id=210f589e6d3944a892f48ee49eaa7cd3, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45, user.id=e5b6823428f24019bb90905ba7707db5) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:39.405984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:39.407658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61cded-2b08-41c9-8c8e-9678554031d2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:39.414073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 106/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:39 2022] GET /identity/v3/role_assignments?user.id=e5b6823428f24019bb90905ba7707db5&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=210f589e6d3944a892f48ee49eaa7cd3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:40.494460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f783-b02d-4b11-8cee-3a9ad6d3ecca None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:40.495484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f783-b02d-4b11-8cee-3a9ad6d3ecca None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:40.496127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897f783-b02d-4b11-8cee-3a9ad6d3ecca None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:40.497931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:40.503365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:40.504175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:40.504639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:40.523813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:40.525307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:40.541537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7924c-2e9e-4381-a82b-81988ae2356c None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:40.541823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7924c-2e9e-4381-a82b-81988ae2356c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:40.542089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7924c-2e9e-4381-a82b-81988ae2356c None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:40.544242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 104/210] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:40.549508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:40.549784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:40.550054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:40.570043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:40.571601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:40.600627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:40.606854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 107/211] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:40.644700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 105/212] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:40.874387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:40.922200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:40.993633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd8fbd-dd89-4e01-aca7-fca4e3fac166 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.023773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.037907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda2f7-4dff-4b4e-8992-2540b21f090a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.038684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cc04-1e48-44b9-8c8c-a8c8bde4fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.039644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cc04-1e48-44b9-8c8c-a8c8bde4fbdb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.040144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cc04-1e48-44b9-8c8c-a8c8bde4fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.040657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cc04-1e48-44b9-8c8c-a8c8bde4fbdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.052507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9cc04-1e48-44b9-8c8c-a8c8bde4fbdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-66e9cc04-1e48-44b9-8c8c-a8c8bde4fbdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:41.057623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:41.058615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:41.059396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 108/213] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:41.060845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8fed4-0927-4ec7-b2c5-c9b9bb620aef None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.060845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8fed4-0927-4ec7-b2c5-c9b9bb620aef None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.061106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8fed4-0927-4ec7-b2c5-c9b9bb620aef None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.062546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 109/214] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:41.067287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8fed4-0927-4ec7-b2c5-c9b9bb620aef None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.078529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e2ca8-f916-4ff4-9453-57b2439ebc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.078529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2ca8-f916-4ff4-9453-57b2439ebc10 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.078529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2ca8-f916-4ff4-9453-57b2439ebc10 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.078529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2ca8-f916-4ff4-9453-57b2439ebc10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.079682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e2ca8-f916-4ff4-9453-57b2439ebc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:41.081178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e2ca8-f916-4ff4-9453-57b2439ebc10 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:41.084570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 106/215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:41.084570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.084570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.084844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.106234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:41.107542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:41.142559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.179605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 107/216] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:41.180547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.200859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8fed4-0927-4ec7-b2c5-c9b9bb620aef None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.236870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.237477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.237885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.237988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.238681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:41.239069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:41.240329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0773c-67a4-4fc3-8f12-4a5c4a991cc4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:41.249380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 110/217] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:41.249380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1f5e-62f2-4c8e-a62f-31282fad096d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.249380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1f5e-62f2-4c8e-a62f-31282fad096d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.249380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1f5e-62f2-4c8e-a62f-31282fad096d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.249380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 111/218] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:41.256113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1f5e-62f2-4c8e-a62f-31282fad096d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.289112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.304073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e6ca-83a7-4644-b022-b7c8b8e9ea24 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.340284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.341069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.341341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.341601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.342245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:41.343846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:41.368401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1f5e-62f2-4c8e-a62f-31282fad096d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.384878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.401180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeddf17-68fe-4cd4-8041-7fe5f8552b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.401742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeddf17-68fe-4cd4-8041-7fe5f8552b50 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.402574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeddf17-68fe-4cd4-8041-7fe5f8552b50 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.402878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeddf17-68fe-4cd4-8041-7fe5f8552b50 None admin] PATH_INFO: `/v3/users/34b7f1ede12d429e9ab41dd12cbce780` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.417215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeddf17-68fe-4cd4-8041-7fe5f8552b50 None admin] RBAC: Authorizing `identity:get_user(user_id=34b7f1ede12d429e9ab41dd12cbce780)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:41.419403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeddf17-68fe-4cd4-8041-7fe5f8552b50 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:41.421059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 112/219] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/users/34b7f1ede12d429e9ab41dd12cbce780 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:41.425151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.425151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.425151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.441416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:41.442627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:41.450522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 108/220] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:41 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:41.451427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.520272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 113/221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:41.521767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.600360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da0806-fc5b-4edb-92d4-c2783b19bed7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.642299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191cb8-03e9-4852-a93d-b2823bc56e63 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.644623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.646068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.646355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.646668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.653918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.661128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.698058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.699319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.699319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.699510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.716162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:41.721435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:41.731730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 114/222] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:41.732518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.744824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:41.746504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:41.867434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208d59d-e874-4d06-a7e7-0f6ed23414c3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:41.879216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 109/223] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:41.879945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.915303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:41.915840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:41.916121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:41.916391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:41.917170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:41.917605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:41.919689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:41.926599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.929663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 115/224] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:41.931045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:41.966965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:41.990110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862d3b3-58df-4e55-975b-a87649d75e25 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.027998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.028639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.028920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.029191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.041372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:42.045157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6551f-eb3f-4012-a582-aa5a52478e95 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:42.054333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:42.055277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:42.056058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 110/225] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:42.056707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.087314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.088250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.088693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.089120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.091460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.093213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.095391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 116/226] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:41 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:42.096336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.175899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3933b-792a-484e-aeb9-92076dd8e443 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.177451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:42.202317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:42.208413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a102a-0c25-4103-bf3f-58be6db8a2a6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.215510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.216150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.216430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.216708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] PATH_INFO: `/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.217867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.219429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.221218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 111/227] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:42 2022] GET /identity/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:42.221998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.247797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.248741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.249283 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.249875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.250928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:42.251305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.252750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.262834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 117/228] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:42.264059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.344259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975da-1241-458b-845c-e1ba94884287 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.382690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f9810-b01c-473b-bb66-95c2ef659148 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.393406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.394602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.394937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.395213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.396230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=34b7f1ede12d429e9ab41dd12cbce780) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:42.396551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.398257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.406627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 112/229] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:42 2022] GET /identity/v3/role_assignments?user.id=34b7f1ede12d429e9ab41dd12cbce780&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:42.407750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.440443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.441408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.441872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.442353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.444900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.446968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.450727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 118/230] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:42 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:42.457926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.474326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:42.520924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:42.598558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907ddc0-6d45-4bf4-9ef1-410a1399bd50 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.668225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79706-b423-46b1-a2a9-8e6046aabca2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.675248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.676067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.676447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.676816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] PATH_INFO: `/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.678143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] RBAC: Authorizing `identity:get_user(user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.680360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.688630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 113/231] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:42 2022] GET /identity/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:42.689943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.721503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342cae3-0af3-45ae-9814-af59289fb38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.722398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342cae3-0af3-45ae-9814-af59289fb38a None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.722860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342cae3-0af3-45ae-9814-af59289fb38a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.723290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342cae3-0af3-45ae-9814-af59289fb38a None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.731381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342cae3-0af3-45ae-9814-af59289fb38a None admin] RBAC: Authorizing `identity:create_grant(project_id=171d79f90f4741afa66f6a552714da58, user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.732844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342cae3-0af3-45ae-9814-af59289fb38a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.803094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5fec0-7ba9-4aa9-96d5-a4807d6e2d8a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:42.804973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:42.841622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:42.842661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:42.843161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:42.843643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:42.844984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:42.846657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:42.852972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 114/232] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:42 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:42.854701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:42.894955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 119/233] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:42 2022] PUT /identity/v3/projects/171d79f90f4741afa66f6a552714da58/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:42.978544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580549-a020-48ba-9a46-dc8df2696b04 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:43.018716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4616d61-68ae-4bee-b065-df69ea5b850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:43.019716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616d61-68ae-4bee-b065-df69ea5b850a None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:43.020175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616d61-68ae-4bee-b065-df69ea5b850a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:43.020620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616d61-68ae-4bee-b065-df69ea5b850a None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:43.023030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4616d61-68ae-4bee-b065-df69ea5b850a None admin] RBAC: Authorizing `identity:create_grant(project_id=171d79f90f4741afa66f6a552714da58, user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50, role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:43.024803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4616d61-68ae-4bee-b065-df69ea5b850a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:43.133375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 115/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:42 2022] PUT /identity/v3/projects/171d79f90f4741afa66f6a552714da58/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50/roles/9108424240854e83b07bba15a59c1a63 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:32:44.212919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f1b6-53a0-49d5-a600-98f6e21fc6e1 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:44.213906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f1b6-53a0-49d5-a600-98f6e21fc6e1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:44.215264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f1b6-53a0-49d5-a600-98f6e21fc6e1 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:44.217353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 120/235] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:44.222746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:44.223216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:44.223287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:44.247489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:44.248753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:44.282979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:44.326484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fe730-bb63-47e6-be71-0fed6b6a9483 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:44.327116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fe730-bb63-47e6-be71-0fed6b6a9483 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:44.327663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fe730-bb63-47e6-be71-0fed6b6a9483 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:44.329222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 121/236] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:44.338786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:44.339317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:44.341004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:44.342815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 116/237] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:44.367695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:44.368893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:44.463787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 122/238] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:44.691177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:44.822399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ef015-dc34-410a-88bf-4e1b97f5247c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:44.868047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:44.868679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:44.868954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:44.869221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:44.870326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:44.872527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:44.874389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 117/239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:44.879492 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:44.917352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:45.031658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bf42e-360e-427b-8751-29ca65729c11 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:45.077935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:45.078580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.078856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.079124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.079782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:45.081223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:45.107655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:45.141058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:45.186087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 123/240] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:44 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:45.241040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9a28-d51a-45d3-b2bc-e562ea3f5c98 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:45.290423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf5df-7f1c-415c-9531-8bb874cff3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:45.291024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf5df-7f1c-415c-9531-8bb874cff3d2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.291300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf5df-7f1c-415c-9531-8bb874cff3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.291570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf5df-7f1c-415c-9531-8bb874cff3d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.310389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcf5df-7f1c-415c-9531-8bb874cff3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-badcf5df-7f1c-415c-9531-8bb874cff3d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:45.315562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:45.316460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:45.317658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 118/241] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:45.322731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:45.352165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51892ce-5607-4b07-b26a-c2456ea146b0 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.352452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51892ce-5607-4b07-b26a-c2456ea146b0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.353078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51892ce-5607-4b07-b26a-c2456ea146b0 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.355259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 119/242] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:45.361819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dee19-0393-496f-8e1d-7e2bad4d17c1 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.362311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dee19-0393-496f-8e1d-7e2bad4d17c1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.362778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dee19-0393-496f-8e1d-7e2bad4d17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.387312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e54dee19-0393-496f-8e1d-7e2bad4d17c1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:45.389200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e54dee19-0393-496f-8e1d-7e2bad4d17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:45.449827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:45.488429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2f72-5a63-4d73-9a40-30c858fc0905 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:45.505548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 120/243] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:45.532864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:45.533656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.534387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.534693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.535372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:45.535683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:45.537056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893546-cd99-440d-8a63-2f08d94bf726 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.537266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:45.537358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893546-cd99-440d-8a63-2f08d94bf726 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.537607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d893546-cd99-440d-8a63-2f08d94bf726 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.540596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 121/244] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:45.546089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2035a18-d3a7-4205-bdb1-8f63df5f4ba8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.546391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2035a18-d3a7-4205-bdb1-8f63df5f4ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.546659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2035a18-d3a7-4205-bdb1-8f63df5f4ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.548104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 124/245] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:45.554335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:45.581468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a2035a18-d3a7-4205-bdb1-8f63df5f4ba8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:45.583104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a2035a18-d3a7-4205-bdb1-8f63df5f4ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:45.602259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:45.670680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 122/246] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:45.676804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c2dd6-0de1-4936-8527-c01bf963c883 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:45.679927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957258f8-c673-4dca-a4a0-690f5441cbed None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.680432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957258f8-c673-4dca-a4a0-690f5441cbed None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.680899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957258f8-c673-4dca-a4a0-690f5441cbed None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.682739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 123/247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:45.688311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.688885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.689347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.711835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:45.713627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:45.716063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:45.716744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.717037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.717312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] PATH_INFO: `/v3/users/a04a88f351ed41f5ad49b8ed63ea8f32` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.721619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:45.740041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] RBAC: Authorizing `identity:get_user(user_id=a04a88f351ed41f5ad49b8ed63ea8f32)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:45.741598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:45.743440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 125/248] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:45 2022] GET /identity/v3/users/a04a88f351ed41f5ad49b8ed63ea8f32 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:45.755701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:45.810226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 124/249] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:45.849653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:45.875934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136de56-5825-436e-9044-d2019bc0b1ac None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:45.923689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:45.924796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:45.925595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:45.926550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:45.952796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:45.991906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d824cd2-0651-4df8-aabc-7d6abb0270e3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.007389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.018809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.020844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.038393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.039508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.039792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.040063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.054191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:46.062579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:46.063654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:46.064636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:46.067364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 125/250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:46.068812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.174555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 126/251] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 02:32:46.175916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.209246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555edc-86fd-4906-a6d7-01375e3f9bf9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.245021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.245928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.246015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.246276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.253249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.256825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:46.262682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:46.271541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 126/252] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:46.272316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.284185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.295421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b057-7fc1-41be-8d22-145f778f9619 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.334801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.336154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.336645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.337108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.337960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:46.338494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.340869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.350517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 127/253] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.351634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.375375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6032b-6529-4b09-8b6a-ce30630258e8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.410601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.411312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.411523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.411777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.423064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:46.428639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:46.429542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:32:46.430337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:46.434697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 127/254] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:46.435592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.463931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a597-f6a2-4712-8c15-38a370efb1ef None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.494932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.502455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.503120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.503398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.503727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.505015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.506445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.513217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 128/255] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.513217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.535779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.537896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffa741-ede6-4017-b797-e7fa629bda2c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.572650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.573424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.573707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.574087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.574886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:46.575194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.576671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.585475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 128/256] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.586605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.626224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465780bd-e462-485a-b7ec-16dd1f63df04 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.663352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.664054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.664345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.664618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] PATH_INFO: `/v3/users/34b7f1ede12d429e9ab41dd12cbce780` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.665776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] RBAC: Authorizing `identity:get_user(user_id=34b7f1ede12d429e9ab41dd12cbce780)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.667365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.669649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 129/257] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/users/34b7f1ede12d429e9ab41dd12cbce780 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.674899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.701647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63a3d7-05d1-4f52-b5cd-7cb43c0c843c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.723761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.739525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.740551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.741065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.741531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.742382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:46.743008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.744736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.755488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 129/258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.756570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.788745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:46.799078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0724f-8400-4515-8a9e-c8e27162eade None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.842509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.843324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.843610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.843885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.844617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] RBAC: Adding query filter params (role.id=210f589e6d3944a892f48ee49eaa7cd3, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=a04a88f351ed41f5ad49b8ed63ea8f32) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:46.844932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.846810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.852554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 130/259] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/role_assignments?user.id=a04a88f351ed41f5ad49b8ed63ea8f32&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=210f589e6d3944a892f48ee49eaa7cd3 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.853430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:46.888241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa455-75fe-4612-81d8-621ebd46007a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:46.944591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:46.945673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:46.946146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:46.946714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] PATH_INFO: `/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:46.950658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] RBAC: Authorizing `identity:get_user(user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:46.952421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:46.958107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 130/260] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:46.960804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:47.048624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb51feb-960d-47e3-a0bd-0c6a177e473e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:47.082151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:47.090282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:47.091498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:47.091968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:47.092870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:47.095900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:47.097700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:47.100016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 131/261] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:47.101046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:47.130212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:47.149312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de612984-aacf-4ed4-a7a7-d6b97e60390d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:47.191763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:47.192412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:47.192691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:47.193262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] PATH_INFO: `/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:47.196924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] RBAC: Authorizing `identity:get_user(user_id=2a4fcbcaa5534bc7a7b7a97c0a92aa50)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:47.198362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:47.203357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 131/262] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:46 2022] GET /identity/v3/users/2a4fcbcaa5534bc7a7b7a97c0a92aa50 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:47.204657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:47.281753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ec8a4-f395-40de-ac5b-6f9d9f23e7f6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:47.328516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:47.329197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:47.329482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:47.329759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:47.405489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:47.406901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:47.436519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:47.471427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec9364-0e57-4596-8ac5-cbdb04e9a07d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:47.512044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:47.518055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 132/263] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:47.519512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:47.545073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:47.545751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:47.546019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:47.546301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58/users/34b7f1ede12d429e9ab41dd12cbce780/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:47.559564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=171d79f90f4741afa66f6a552714da58, user_id=34b7f1ede12d429e9ab41dd12cbce780, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:47.561009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:47.630359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9531b96-1cda-44fe-8eec-1c724a3a6004 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:47.646767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 132/264] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:47 2022] PUT /identity/v3/projects/171d79f90f4741afa66f6a552714da58/users/34b7f1ede12d429e9ab41dd12cbce780/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:47.647775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:47.668303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:47.688523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:47.689159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:47.689445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:47.689724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:47.768116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:47.769621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:47.921230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80973e-f6e8-499d-99ef-05bf3554e7c8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:47.971398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 133/265] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:47.976578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:47.982445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:47.983120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:47.983402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:47.983675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:47.985958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:47.987468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:47.989163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 133/266] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:47 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:48.002088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:48.021526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:48.098398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:48.116145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eae65-7c49-4a59-a179-92171b4116ac None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:48.158121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:48.158977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.159692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.160188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.162407 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:48.164529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:48.166712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 134/267] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:47 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:48.175693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:48.259794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14126a-50cb-43e5-85de-37d5a2222a4e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:48.332200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:48.333043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.333489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.333982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.334941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:48.335393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:48.337070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed2c07-3922-405d-afed-b45fe64dfe9f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:48.349848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:48.360184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 134/268] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:48 2022] GET /identity/v3/role_assignments?user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:48.361875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96489c97-3a1d-4060-ae2d-c0a5fbdeba74 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.362326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96489c97-3a1d-4060-ae2d-c0a5fbdeba74 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.362763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96489c97-3a1d-4060-ae2d-c0a5fbdeba74 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.364474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 135/269] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:48.368316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fd321-32e2-4952-9872-70a28f358de6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:48.372058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.372635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.373046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.420063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:48.421631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:48.459464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:48.460218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.460602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.460975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.461844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] RBAC: Adding query filter params (role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:48.462266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:48.463887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2e08e-4305-4253-9317-24664b670b23 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:48.471804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 135/270] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:48 2022] GET /identity/v3/role_assignments?user.id=2a4fcbcaa5534bc7a7b7a97c0a92aa50&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=9108424240854e83b07bba15a59c1a63 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:48.493499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3706e03-cf2e-4118-8b07-da37ea0da5e5 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.493955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3706e03-cf2e-4118-8b07-da37ea0da5e5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.494296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3706e03-cf2e-4118-8b07-da37ea0da5e5 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.500502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 136/271] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:48.518505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:48.518505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:48.518505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:48.560445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:48.564155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:48.579886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 136/272] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:48.693678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 137/273] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:48.957737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:49.014308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:49.113652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a727-dbb9-475e-8711-a3765e29fef5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:49.167323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:49.170645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:49.170916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:49.171313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:49.171592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:49.184982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:49.189461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:49.190366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:49.191241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:49.199973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:49.307100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:49.325489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6119c5-232a-4142-9242-51591530cf8e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:49.336844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:49.341407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7733ac-853d-4d59-ae1f-7a9d601f24ba None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:49.368810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:49.369558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:49.369906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:49.370607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:49.371667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:49.373183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:49.375375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:49.381662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:49.385825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:49.387276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:49.387800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:49.388277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:49.389405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] RBAC: Adding query filter params (name=member) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:49.389928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:49.391606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:49.400925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 138/276] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:49.408403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:49.512871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83716-3d73-4b95-b18d-a6749e0ab67f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:49.537724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98b3b4-e6d2-4be4-9147-7dc2746ac288 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:49.555690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f9a0-00dc-4f22-b4a2-a4b861e96cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:49.556606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9a0-00dc-4f22-b4a2-a4b861e96cdb None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:49.556717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9a0-00dc-4f22-b4a2-a4b861e96cdb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:49.556923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9a0-00dc-4f22-b4a2-a4b861e96cdb None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:49.557640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f9a0-00dc-4f22-b4a2-a4b861e96cdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:49.559626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f9a0-00dc-4f22-b4a2-a4b861e96cdb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:49.580873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:49.582990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:49.582990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:49.582990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] PATH_INFO: `/v3/users/c37397c6beae41e7b8354b9c9ecb1c3f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:49.597864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=c37397c6beae41e7b8354b9c9ecb1c3f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:49.599441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:49.606499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 139/277] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:49 2022] GET /identity/v3/users/c37397c6beae41e7b8354b9c9ecb1c3f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:49.608323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:49.632968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:49.648130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 139/278] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:32:49 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:49.729465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac756e-4d9d-427a-bf13-ac8472f5f5c2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:49.770952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:49.771575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:49.771856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:49.772129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:49.772934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, user.id=c37397c6beae41e7b8354b9c9ecb1c3f, scope.system=all) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:49.773246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:49.774827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44df244-eed1-4f9a-94a6-a194ad208a11 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:49.781953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 140/279] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 14 02:32:49 2022] GET /identity/v3/role_assignments?user.id=c37397c6beae41e7b8354b9c9ecb1c3f&scope.system=all&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:50.035496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19ca4-c82a-4df5-badb-1b7416e1b2d0 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:50.035779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19ca4-c82a-4df5-badb-1b7416e1b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:50.036055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19ca4-c82a-4df5-badb-1b7416e1b2d0 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:50.037716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 140/280] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:50.043413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cba2d-fb3a-4030-bf4d-abe24917017a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:50.043697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cba2d-fb3a-4030-bf4d-abe24917017a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:50.043966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cba2d-fb3a-4030-bf4d-abe24917017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:50.064447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-381cba2d-fb3a-4030-bf4d-abe24917017a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:50.065639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-381cba2d-fb3a-4030-bf4d-abe24917017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:50.157875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 141/281] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:50.560269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf200-511b-437f-8459-325e9137bda4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:50.560777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf200-511b-437f-8459-325e9137bda4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:50.560777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcf200-511b-437f-8459-325e9137bda4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:50.562153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 141/282] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:50.572090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:50.572375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:50.572647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:50.577421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf200-511b-437f-8459-325e9137bda4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:50.591754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:50.616268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:50.617459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:50.637022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:50.752692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 142/283] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:50.756572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcf200-511b-437f-8459-325e9137bda4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:50.803713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:50.804359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:50.804637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:50.804960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:50.820941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:50.828059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:50.829010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:50.829797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:50.834337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 142/284] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:50.835777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:50.948337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e51c8-2a43-48cb-be01-3f57031db46b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:50.988635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:50.989325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:50.989605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:50.989878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:50.990616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:50.990927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:50.992411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:51.007836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 143/285] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:51.009220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.068873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.079779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:51.085585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:51.120309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e2596-bc59-48b7-8f3f-10d7f1938fbe None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:51.160597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:51.161231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:51.161564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:51.161841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] PATH_INFO: `/v3/users/a04a88f351ed41f5ad49b8ed63ea8f32` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:51.163056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] RBAC: Authorizing `identity:get_user(user_id=a04a88f351ed41f5ad49b8ed63ea8f32)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:51.165054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:51.171754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 143/286] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:51 2022] GET /identity/v3/users/a04a88f351ed41f5ad49b8ed63ea8f32 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:51.174449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.309657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6cca8-678f-48c9-8693-3b20a2b41738 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:51.317893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810995-e8f1-43ba-bf23-9d64390f9a7c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:51.377397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:51.379065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:51.380002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:51.380791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:51.381271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:51.382603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:51.383049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:51.383211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:51.383642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:51.384715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:51.387576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 144/287] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:51 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:51.398533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.398533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:51.408381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:51.413926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:51.414801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:51.415597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:51.422845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 144/288] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:51.431566 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.535042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:51.571879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733e5f8-2fb3-4844-9623-8b1e6c33722f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:51.589616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d51e1-89b6-4399-bd27-6c88b6c04e81 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:51.623884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:51.624501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:51.624818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:51.625100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:51.625767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:51.626117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:51.627654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:51.632820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:51.633485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:51.633767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:51.634040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58/users/a04a88f351ed41f5ad49b8ed63ea8f32/roles/210f589e6d3944a892f48ee49eaa7cd3` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:51.635999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=171d79f90f4741afa66f6a552714da58, user_id=a04a88f351ed41f5ad49b8ed63ea8f32, role_id=210f589e6d3944a892f48ee49eaa7cd3)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:51.637918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 145/289] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:51.638185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:51.645565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.730174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 145/290] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:32:51 2022] PUT /identity/v3/projects/171d79f90f4741afa66f6a552714da58/users/a04a88f351ed41f5ad49b8ed63ea8f32/roles/210f589e6d3944a892f48ee49eaa7cd3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:51.753932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84203392-a45d-4acb-b306-4335abe33ae7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:51.795633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:51.808468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:51.809574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:51.810014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:51.810733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] PATH_INFO: `/v3/users/34b7f1ede12d429e9ab41dd12cbce780` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:51.815848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] RBAC: Authorizing `identity:get_user(user_id=34b7f1ede12d429e9ab41dd12cbce780)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:51.817433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:51.819680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 146/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:51 2022] GET /identity/v3/users/34b7f1ede12d429e9ab41dd12cbce780 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:51.825815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:51.937696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:51.988618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bb4b3-cc37-4578-adbc-6d003d6c8f90 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:52.024490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a570-091c-4598-be95-271a1bf7d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:52.025114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a570-091c-4598-be95-271a1bf7d422 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.025396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a570-091c-4598-be95-271a1bf7d422 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.025674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a570-091c-4598-be95-271a1bf7d422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.114135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a570-091c-4598-be95-271a1bf7d422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:52.116017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18a570-091c-4598-be95-271a1bf7d422 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:52.181757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:52.243257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 146/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:52.248465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:52.376363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33da06b-0b76-438e-810f-f8b7f2d82836 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:52.400415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1414c1-da7b-435d-af9d-4a234f379d3c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.400863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1414c1-da7b-435d-af9d-4a234f379d3c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.401234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1414c1-da7b-435d-af9d-4a234f379d3c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.403089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 147/293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:52.408239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ccd4d-1a6c-4e3c-a3e9-a483d6ee07ca None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.408641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ccd4d-1a6c-4e3c-a3e9-a483d6ee07ca None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.409018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ccd4d-1a6c-4e3c-a3e9-a483d6ee07ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.415741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:52.418191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.420037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.420471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.421954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:52.424374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:52.430060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 147/294] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:52 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:52.436678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:52.442201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e09ccd4d-1a6c-4e3c-a3e9-a483d6ee07ca None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:52.448350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e09ccd4d-1a6c-4e3c-a3e9-a483d6ee07ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:52.554344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:52.573139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 148/295] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:52.609046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0a99-cd2c-42c9-82e8-405b365b99de None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.609678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0a99-cd2c-42c9-82e8-405b365b99de None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.609678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0a99-cd2c-42c9-82e8-405b365b99de None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.611241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 149/296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:32:52.616354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692e636-6f68-4782-b5b1-973bb174256a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.616597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692e636-6f68-4782-b5b1-973bb174256a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.616836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692e636-6f68-4782-b5b1-973bb174256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.624841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e1a7-b0be-4812-9c2e-b3da92ecb46e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:52.635373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9692e636-6f68-4782-b5b1-973bb174256a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:52.636692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9692e636-6f68-4782-b5b1-973bb174256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:52.689827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:52.690446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.690748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.691019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.691747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=34b7f1ede12d429e9ab41dd12cbce780) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:52.692085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:52.693602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21840d5-f30a-4f40-8113-c6149a149657 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:52.706441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 150/297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:52.712356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146ecf-219a-4d90-8991-bd004bcac768 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.712639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146ecf-219a-4d90-8991-bd004bcac768 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.712860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 148/298] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:52 2022] GET /identity/v3/role_assignments?user.id=34b7f1ede12d429e9ab41dd12cbce780&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:52.712996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f146ecf-219a-4d90-8991-bd004bcac768 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.714162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 151/299] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:52.723155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:52.723460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:52.723693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:52.744347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:52.746105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:52.852585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 149/300] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:52.936777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146ecf-219a-4d90-8991-bd004bcac768 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:52.970164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.025054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.103492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.108308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f146ecf-219a-4d90-8991-bd004bcac768 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.151688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c52d0a-f07b-4711-8680-ea37551fd770 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.154049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.155544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.155833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.156109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.169990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:53.175321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:53.176387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 152/301] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:53.177345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.197111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.198555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.199435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.199836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.214401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:53.221021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:53.221884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:32:53.222684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 150/302] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:53.223354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.281631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.300608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1905d-a872-488b-9cf6-2ecd910d479e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.336536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.337450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.338025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.338302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.340007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.341448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.343067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 153/303] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:53.343832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.344649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e8fe-be6e-4098-9515-33bf5bbbd8c8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.365544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.382344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.383044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.383322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.383595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.384247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:53.384548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.385921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.395254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 151/304] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:53.396058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.460287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1fc0a-da03-4c16-95e8-8bc7fadcb5d8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.497344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.497837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7af36-d766-4e59-b8cb-8bc6854fb3f1 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.497974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.498219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.498514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.499172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:53.499484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.500864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.509241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 154/305] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:53.510038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.528215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.538448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.539098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.539380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.539656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] PATH_INFO: `/v3/groups` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.540287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.541731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.609970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 152/306] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 14 02:32:53 2022] POST /identity/v3/groups => generated 229 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:53.613563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c431475-ac59-4744-bdbf-abc28addc6dc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.615499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.667454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.668084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.668433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.668794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] PATH_INFO: `/v3/users/9972c96e98bd4fb2ab32c05b3d81802f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.674503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.686275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] RBAC: Authorizing `identity:get_user(user_id=9972c96e98bd4fb2ab32c05b3d81802f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.687965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.694980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 155/307] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/users/9972c96e98bd4fb2ab32c05b3d81802f => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:53.697705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.764139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566758-4247-4448-b0cb-0cfab7726497 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.812343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.818339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.819008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.819281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.819554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] PATH_INFO: `/v3/users/c37397c6beae41e7b8354b9c9ecb1c3f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.820677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=c37397c6beae41e7b8354b9c9ecb1c3f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.822125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.823947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 153/308] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/users/c37397c6beae41e7b8354b9c9ecb1c3f => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:53.830042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:53.852710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fead6c-845f-4db0-881d-1ea47afbc152 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.904149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.905003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.905355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.905697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.906620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] RBAC: Adding query filter params (role.id=210f589e6d3944a892f48ee49eaa7cd3, user.id=9972c96e98bd4fb2ab32c05b3d81802f, scope.system=all) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:53.907001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.908499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399fb2c-485a-4897-907f-795692e4b687 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:53.921676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 156/309] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 14 02:32:53 2022] GET /identity/v3/role_assignments?user.id=9972c96e98bd4fb2ab32c05b3d81802f&scope.system=all&role.id=210f589e6d3944a892f48ee49eaa7cd3 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:53.950839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b22913-71de-46d2-b849-a950fea08ce9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:53.961837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:53.989650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e54c-965c-49ba-b9a0-35a39e2d7623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:53.990324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e54c-965c-49ba-b9a0-35a39e2d7623 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:53.990634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e54c-965c-49ba-b9a0-35a39e2d7623 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:53.990907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e54c-965c-49ba-b9a0-35a39e2d7623 None admin] PATH_INFO: `/v3/system/users/c37397c6beae41e7b8354b9c9ecb1c3f/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:53.992388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e54c-965c-49ba-b9a0-35a39e2d7623 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c37397c6beae41e7b8354b9c9ecb1c3f, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:53.993902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e54c-965c-49ba-b9a0-35a39e2d7623 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:54.097462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 154/310] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 14 02:32:53 2022] PUT /identity/v3/system/users/c37397c6beae41e7b8354b9c9ecb1c3f/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:32:54.394282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c3d59-49a9-41ec-b089-ba0370e08d6a None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:54.394611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c3d59-49a9-41ec-b089-ba0370e08d6a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:54.394906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c3d59-49a9-41ec-b089-ba0370e08d6a None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:54.396428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 157/311] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:54.401532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:54.402362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:54.402704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:54.421948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:54.423343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:54.495862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 155/312] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:54.767215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c3d59-49a9-41ec-b089-ba0370e08d6a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:54.876125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c3d59-49a9-41ec-b089-ba0370e08d6a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:54.910774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:54.911398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:54.911675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:54.911946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:54.914634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:54.923181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:54.928069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:54.934327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:54.935180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 158/313] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:54.936338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:55.042437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a14a8c-fd42-435f-a2cc-b6c914f2180b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:55.043871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:55.083359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:55.083976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.084252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.084518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:55.090692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:55.090881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:55.092298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:55.101704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 156/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:55.109028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:55.214099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df59da-1c10-4bf4-a829-e6094d7dcb54 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:55.250497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:55.251499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.251976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.252442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] PATH_INFO: `/v3/users/a04a88f351ed41f5ad49b8ed63ea8f32` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:55.253786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] RBAC: Authorizing `identity:get_user(user_id=a04a88f351ed41f5ad49b8ed63ea8f32)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:55.255450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:55.257625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 159/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:55 2022] GET /identity/v3/users/a04a88f351ed41f5ad49b8ed63ea8f32 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:55.263421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:55.368812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea147b6-e94f-46b5-a890-48b14fe16623 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:55.404654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:55.405308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.405583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.405856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:55.443030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:55.481458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:55.482967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:55.587392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 157/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:32:55.594183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:55.666628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:55.706294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3078-46a8-4498-9bb7-6158cb63fb32 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:55.742656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b05c11-1fb1-4c9e-af62-252d911a30f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:55.743287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05c11-1fb1-4c9e-af62-252d911a30f9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.743563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05c11-1fb1-4c9e-af62-252d911a30f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.743832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b05c11-1fb1-4c9e-af62-252d911a30f9 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:55.744956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05c11-1fb1-4c9e-af62-252d911a30f9 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:55.747005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b05c11-1fb1-4c9e-af62-252d911a30f9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:55.748887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 160/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:32:55 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:55.754677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:55.821322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:55.867430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462484c-94ee-4fc5-a12c-8fac3b03c409 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:55.906347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:55.907000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.907278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.907545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:55.908269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] RBAC: Adding query filter params (role.id=210f589e6d3944a892f48ee49eaa7cd3, scope.project.id=171d79f90f4741afa66f6a552714da58, user.id=a04a88f351ed41f5ad49b8ed63ea8f32) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:55.908572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:55.910011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13ecfb-b9bb-452d-9d48-6684b586d178 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:55.916767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 158/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:32:55 2022] GET /identity/v3/role_assignments?user.id=a04a88f351ed41f5ad49b8ed63ea8f32&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=210f589e6d3944a892f48ee49eaa7cd3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:55.978358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c4f9-91cf-444a-ac40-de08c29c7dc9 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.978358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c4f9-91cf-444a-ac40-de08c29c7dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.978358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c4f9-91cf-444a-ac40-de08c29c7dc9 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:55.978358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 161/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:55.985709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f86a12-c518-484c-ae87-7e3cf780192d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:55.986708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f86a12-c518-484c-ae87-7e3cf780192d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:55.987185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f86a12-c518-484c-ae87-7e3cf780192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.008330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-97f86a12-c518-484c-ae87-7e3cf780192d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:56.009889 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-97f86a12-c518-484c-ae87-7e3cf780192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:56.098664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 159/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:56.216556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622bc32-5bd8-4de6-8af4-3857d5628639 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.216875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622bc32-5bd8-4de6-8af4-3857d5628639 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.217105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622bc32-5bd8-4de6-8af4-3857d5628639 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.218495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 162/321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:56.223615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee271-15e5-45c4-ad04-9b4d1e60e1bf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.223908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee271-15e5-45c4-ad04-9b4d1e60e1bf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.224185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee271-15e5-45c4-ad04-9b4d1e60e1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.247074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b05ee271-15e5-45c4-ad04-9b4d1e60e1bf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:56.248854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b05ee271-15e5-45c4-ad04-9b4d1e60e1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:56.316819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:56.330835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 160/322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:56.377965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932000-eee0-4f15-a0d0-4ffb1d07d83d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.378297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932000-eee0-4f15-a0d0-4ffb1d07d83d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.378556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932000-eee0-4f15-a0d0-4ffb1d07d83d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.380037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 163/323] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:56.384899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d932000-eee0-4f15-a0d0-4ffb1d07d83d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:56.385317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.385522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.385795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.406651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:56.407833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:56.475938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 161/324] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:56.492822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d932000-eee0-4f15-a0d0-4ffb1d07d83d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:56.523223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:56.528916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:56.529711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.529989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.530262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.531410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:56.532839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:56.534696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 164/325] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:32:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:56.539940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:56.601904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:56.640216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df870-1983-460b-b1b8-9fe636f47deb None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:56.662006 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:56.678774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:56.679384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.679665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.679937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] PATH_INFO: `/v3/groups` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.680575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:56.682019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:56.709140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821823-4de0-4d83-b30f-124236fd1882 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:56.742417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:56.743016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.743292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.743561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.754227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:56.759264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:56.760142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:56.760931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 165/326] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:32:56.761638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:56.767844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 162/327] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Sep 14 02:32:56 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:32:56.768900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:56.829584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:56.875959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c90527-4c4b-4d07-a1ea-7aeb8751835f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:56.887124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb7821-2951-4e22-b12b-22d6c44ecab1 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:56.914579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:56.915228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.915531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.915798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.928613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:32:56.928811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:56.929695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:56.930177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:56.930689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:56.931645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:56.932152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:32:56.933606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:32:56.934799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:32:56.935598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 166/328] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:32:56.936779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:56.940594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:56.947560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 163/329] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:56.954033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:57.001502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:57.066929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e01fa-759a-4048-ad81-34465a7de8e9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:57.072399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc186a-045d-4831-90d8-1d07be76c9ec None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:57.094316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:57.113584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:57.114216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:57.114632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:57.114916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:57.115681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:57.115995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:57.117374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:57.117483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:57.118078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:57.118360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:57.118663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] PATH_INFO: `/v3/users/9972c96e98bd4fb2ab32c05b3d81802f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:57.120372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] RBAC: Authorizing `identity:get_user(user_id=9972c96e98bd4fb2ab32c05b3d81802f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:57.121850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:57.124385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 164/330] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:56 2022] GET /identity/v3/users/9972c96e98bd4fb2ab32c05b3d81802f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:57.128933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:32:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:57.129553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:57.133208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:57.266843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6eee4-69de-4b09-9cf7-d8ea44f98474 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:57.273043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de76f3-4ea7-4cf0-aeb7-99ddab6ca4f8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:57.278088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:57.324552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4a3b3-9daf-4cde-a531-488ef564162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:57.325386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a3b3-9daf-4cde-a531-488ef564162b None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:57.325669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a3b3-9daf-4cde-a531-488ef564162b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:57.325943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a3b3-9daf-4cde-a531-488ef564162b None admin] PATH_INFO: `/v3/system/users/9972c96e98bd4fb2ab32c05b3d81802f/roles/210f589e6d3944a892f48ee49eaa7cd3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:57.328114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a3b3-9daf-4cde-a531-488ef564162b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9972c96e98bd4fb2ab32c05b3d81802f, role_id=210f589e6d3944a892f48ee49eaa7cd3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:57.330539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a3b3-9daf-4cde-a531-488ef564162b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:57.331090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:57.331986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:57.332604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:57.333452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] PATH_INFO: `/v3/users/c37397c6beae41e7b8354b9c9ecb1c3f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:57.335025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] RBAC: Authorizing `identity:get_user(user_id=c37397c6beae41e7b8354b9c9ecb1c3f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:57.336660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:57.338429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 168/332] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:32:57 2022] GET /identity/v3/users/c37397c6beae41e7b8354b9c9ecb1c3f => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:32:57.345397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:57.394196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 165/333] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Sep 14 02:32:57 2022] PUT /identity/v3/system/users/9972c96e98bd4fb2ab32c05b3d81802f/roles/210f589e6d3944a892f48ee49eaa7cd3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:32:57.404175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:57.461012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cba24-3255-4f70-90e0-31fd1dc5e41a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:32:57.503118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:32:57.503803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:57.504085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:57.504357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:57.505148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] RBAC: Adding query filter params (role.id=bde60ff36c1749398f883222ee4c5e23, user.id=c37397c6beae41e7b8354b9c9ecb1c3f, scope.system=all) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:32:57.505461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:32:57.506941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba11c-5830-4a85-843b-39c2ae6922f1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:32:57.522890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 169/334] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 14 02:32:57 2022] GET /identity/v3/role_assignments?user.id=c37397c6beae41e7b8354b9c9ecb1c3f&scope.system=all&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:32:59.330369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517c67-83d3-4f22-be7d-60d37cdc22cd None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:59.330369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517c67-83d3-4f22-be7d-60d37cdc22cd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:59.330369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517c67-83d3-4f22-be7d-60d37cdc22cd None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:59.331587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 166/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:59.338250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c2cf-079f-41b8-acaa-9652a0035b35 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:59.339134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c2cf-079f-41b8-acaa-9652a0035b35 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:59.340255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c2cf-079f-41b8-acaa-9652a0035b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:59.361633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1058c2cf-079f-41b8-acaa-9652a0035b35 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:59.363187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1058c2cf-079f-41b8-acaa-9652a0035b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:59.439325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 170/336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:32:59.699774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee63f-6279-468f-ae71-db6a9c0308c8 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:59.700476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee63f-6279-468f-ae71-db6a9c0308c8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:59.700963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee63f-6279-468f-ae71-db6a9c0308c8 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:59.702841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 167/337] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:32:59.708019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:32:59.708533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:32:59.709008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:32:59.732383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:32:59.733895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:32:59.746176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee63f-6279-468f-ae71-db6a9c0308c8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:32:59.776182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:32:59.845350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 171/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:32:59.964412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee63f-6279-468f-ae71-db6a9c0308c8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:00.004649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:00.005633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.006105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.006589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.022355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:00.028304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:00.029162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:00.029935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:00.032612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 168/339] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:00.040849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:00.178293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e062f-b199-4630-9046-f3386998f1c1 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:00.221553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:00.222103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.222385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.222718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.223386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:00.223691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:00.225056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:00.238001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 172/340] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:00.243451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:00.297746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:00.337235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:00.395342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:00.414761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda43a99-e436-46e5-829b-cba08575c1da None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:00.510561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a6a6c-5b45-48c6-aaf1-0ecd85697417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:00.512636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6a6c-5b45-48c6-aaf1-0ecd85697417 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.512913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6a6c-5b45-48c6-aaf1-0ecd85697417 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.513187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a6a6c-5b45-48c6-aaf1-0ecd85697417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.550001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63a7c8-d425-4a0a-955f-1a2b8e08fed8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:00.592525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f05c-caa2-4f1d-bfaf-d89910e52e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:00.593297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f05c-caa2-4f1d-bfaf-d89910e52e78 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.593583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f05c-caa2-4f1d-bfaf-d89910e52e78 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.593856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f05c-caa2-4f1d-bfaf-d89910e52e78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.607881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31f05c-caa2-4f1d-bfaf-d89910e52e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-bb31f05c-caa2-4f1d-bfaf-d89910e52e78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:00.613617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:00.614627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:00.616045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 173/341] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:00.616711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbb2d-da8d-47d3-8121-ad272a41efe4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.617008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbb2d-da8d-47d3-8121-ad272a41efe4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.617291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bbb2d-da8d-47d3-8121-ad272a41efe4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.619158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 174/342] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:00.623789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c63b3-f39a-4d00-bdbf-3527a35b4813 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.624073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c63b3-f39a-4d00-bdbf-3527a35b4813 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.624347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c63b3-f39a-4d00-bdbf-3527a35b4813 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.625952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 175/343] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:00.626643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c63b3-f39a-4d00-bdbf-3527a35b4813 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:00.633143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a6a6c-5b45-48c6-aaf1-0ecd85697417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:00.634665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a6a6c-5b45-48c6-aaf1-0ecd85697417 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:00.685027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:00.747074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:00.760244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c63b3-f39a-4d00-bdbf-3527a35b4813 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:00.778893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 169/344] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:00.780876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.781312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.781732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.799673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:00.800799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.800799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.801238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.802576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:00.803980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:00.805478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886971-a4ef-44a8-9b55-b2573041acc5 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:00.807677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:00.810824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:00.816428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 176/345] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:00.817803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:00.818197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:00.818568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:00.842447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:00.844008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:00.899161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 170/346] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:00.900385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:00.937165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 177/347] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:00.938688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.008194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:01.094274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:01.108860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6087-4561-4176-a260-8e8a9a2ad88b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.133701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278d30e-a21e-4d7c-a1f9-77cc9e353c9f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.177613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.178253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.178559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.178834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.179975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:01.181513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:01.183796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 171/348] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:00 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:01.189337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.204314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.204984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.205265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.205532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.321555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:01.323322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:01.406587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f774fe-9070-4172-b454-44fc605a5f32 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.418675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:01.438192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 178/349] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:01.439137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.480402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:01.513572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.513572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.513572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.513572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.523330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:01.524955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:01.527464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 172/350] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:01.529205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.655132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa7260-9177-4935-9124-453854cea3b8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.716071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97ff03-4a3f-4ff1-a808-244403f9975a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.718250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.718936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.719217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.719894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.743887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:01.749921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:01.751045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 02:33:01.751873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:01.752951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 179/351] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:01.752951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.773907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.774627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.774913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.775183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.776404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:01.778536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:01.781166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 173/352] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:01.782055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.821039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:01.857189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:01.917047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c3d1-776d-43b6-b3ce-6c6311ccf3cf None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.922538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709065-1bed-44f0-b21c-d9df11e23061 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:01.959777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.960417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.960692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.960995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.961869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:01.962194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:01.964008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4f6e5-f651-487d-8a66-af5727b3c208 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:01.965426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:01.966376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.966895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.967482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.972760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 174/353] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:01.974145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7f0b-e8de-451e-ae9b-ae26b40730a0 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:01.974430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7f0b-e8de-451e-ae9b-ae26b40730a0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:01.974850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7f0b-e8de-451e-ae9b-ae26b40730a0 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:01.976243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 175/354] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:01.979385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be7f0b-e8de-451e-ae9b-ae26b40730a0 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:01.980981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:01.986937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:01.987860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:01.988633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:01.990582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 180/355] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:01.991513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:02.138698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be7f0b-e8de-451e-ae9b-ae26b40730a0 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.145004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ca596-3044-4a73-b66a-b78bd0a8d0ea None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.159631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:02.168178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:02.179547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.180402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.180851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.181266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.182124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:02.182618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.184232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.189777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7cd93-f060-443a-97a5-209a99d6d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.190641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7cd93-f060-443a-97a5-209a99d6d44b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.190994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7cd93-f060-443a-97a5-209a99d6d44b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.191763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7cd93-f060-443a-97a5-209a99d6d44b None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.192663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7cd93-f060-443a-97a5-209a99d6d44b None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.194196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7cd93-f060-443a-97a5-209a99d6d44b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.197406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 181/356] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:02.199268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 176/357] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:02.200510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:02.206124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.206124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.206124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.236197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:02.237322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:02.321464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 182/358] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:02.322964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:02.330352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d937ca-b5fa-4594-966c-bae0609b906d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.372792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.373466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.373976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.374253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.374955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:02.375259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.377612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.388111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 177/359] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:02.389219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:02.448095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:02.452697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea865d9-12ae-4cc3-9551-44b212fd8235 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.458856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:02.488424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.489393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.489875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.490365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.491379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:02.491893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.493537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15e6b-6b92-470b-b767-937d8405faf3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.500422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 183/360] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:02 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=9108424240854e83b07bba15a59c1a63 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:02.501892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731f94-0154-46e7-b86f-2c1083ea57c2 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.502382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731f94-0154-46e7-b86f-2c1083ea57c2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.504379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731f94-0154-46e7-b86f-2c1083ea57c2 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.506345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 184/361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:02.507423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731f94-0154-46e7-b86f-2c1083ea57c2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:02.514708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904afb2-e09b-474e-9b8b-fb6145c78fb8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.569843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4747-4c51-4016-b409-08b4d73fc01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.570510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4747-4c51-4016-b409-08b4d73fc01c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.570795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4747-4c51-4016-b409-08b4d73fc01c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.571064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4747-4c51-4016-b409-08b4d73fc01c None admin] PATH_INFO: `/v3/users/9972c96e98bd4fb2ab32c05b3d81802f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.572316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4747-4c51-4016-b409-08b4d73fc01c None admin] RBAC: Authorizing `identity:get_user(user_id=9972c96e98bd4fb2ab32c05b3d81802f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.573839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4747-4c51-4016-b409-08b4d73fc01c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.576909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 178/362] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:33:02 2022] GET /identity/v3/users/9972c96e98bd4fb2ab32c05b3d81802f => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:02.578245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.578553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.578825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.599680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:02.600894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:02.690280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 179/363] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:02.691297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:02.698437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731f94-0154-46e7-b86f-2c1083ea57c2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.769163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.769764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.770037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.770328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.785954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:02.822398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:02.864369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89261ec-e9fc-43bf-a9f6-7927d2283868 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:02.882934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.884882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.932541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:02.933452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:02.933875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:02.934309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:02.935521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] RBAC: Adding query filter params (role.id=210f589e6d3944a892f48ee49eaa7cd3, user.id=9972c96e98bd4fb2ab32c05b3d81802f, scope.system=all) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:02.935980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:02.937812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:02.955615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Sep 14 02:33:02 2022] GET /identity/v3/role_assignments?user.id=9972c96e98bd4fb2ab32c05b3d81802f&scope.system=all&role.id=210f589e6d3944a892f48ee49eaa7cd3 => generated 510 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:02.957159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.134423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 185/365] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:03.141666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.149114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584e173-7a2e-40d0-8b20-ba6869344d2b None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.160572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:03.217628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.218321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.218696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.218964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.232108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:03.239834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:03.240741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:03.241535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 181/366] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:03.242187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.249400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:03.299040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3647-7b86-463b-934d-ae4036701f7a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.342693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.343252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.343526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.343792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.356098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:03.361055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:03.361917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:03.362727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:03.363921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 186/367] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:03.364915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.391380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec9799-e170-40b9-914d-f96624bfc6cc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.435842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.436864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.437346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.437820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.440105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:03.441778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:03.443991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 182/368] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:03.449949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.483999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d591d95-486b-475b-b85b-861984009f41 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.489545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:03.510111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:03.522109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.522644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.523254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.524152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.524846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:03.525155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:03.526590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:03.541006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 187/369] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:03.541935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.568024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde4970-6046-40b1-a6c1-4b3832b11f2a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.607000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.607971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.608526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.609134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.610042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:03.610351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:03.611795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:03.622041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 183/370] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:03.622973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.657760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574745e-6516-493b-ae57-088373c3c3c0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.696769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.697410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.697689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.697961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.699748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:03.701297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:03.703359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 188/371] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:03.704200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:03.737082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:03.743696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e949-e657-405c-8086-d1741ae2dbec None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.781428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:03.790643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.791426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.793020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.793393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.832801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad33c-b2f2-4a82-8d9f-5d1a555e3efc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:03.882740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:03.883530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:03.884187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:03.884613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:03.885069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:03.885517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:03.980532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:03.982104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.001119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:04.010706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 184/372] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:04.011730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.052982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:04.121420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 189/373] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:04.122563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.163102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f788e-7a9e-4bc1-98e7-7d1345196407 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.216201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.216813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.217089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.217356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.218093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=171d79f90f4741afa66f6a552714da58) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:04.218406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.220483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.227912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 185/374] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:04.229344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.257713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b16d3-ee65-45ae-bff9-17c6cef99f4a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.311496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.311702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.311929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.312200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.313475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.314998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.317199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 190/375] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:04.319972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:04.325509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.390331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:04.397956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24ab9c-990e-4d1b-ba0d-04a6e158da5e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.473919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.474974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.475471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.476016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] PATH_INFO: `/v3/projects/08712a2fc7d14bcea78d3e24178be8ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.477437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=08712a2fc7d14bcea78d3e24178be8ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.479205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.481952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 186/376] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/projects/08712a2fc7d14bcea78d3e24178be8ca => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:04.490502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b0ba-9ad9-4760-809f-9a767ae5b067 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.499960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.540566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.541219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.541499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.541771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.544950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.546394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.549287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 191/377] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:04.554584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.679737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:04.686232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801f370-017e-4e84-8b91-8393669ce5c3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.704992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ff10-c14b-411c-bbaf-dca5f6844235 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.745762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:04.761413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.762956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.763243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.763524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] PATH_INFO: `/v3/groups/7e9c544326a94130920162b13ba2277f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.779333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] RBAC: Authorizing `identity:get_group(group_id=7e9c544326a94130920162b13ba2277f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.781024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.784061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/groups/7e9c544326a94130920162b13ba2277f => generated 229 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:04.788485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.789133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.789244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:04.789409 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.789798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.790583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=171d79f90f4741afa66f6a552714da58) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:04.790901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.792958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6c923-6849-420e-b2eb-ddb53f13089f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.805996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 192/379] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=9108424240854e83b07bba15a59c1a63 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:04.924880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba97ea-f2be-4a24-8428-1398a0471a15 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:04.969765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:04.970389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:04.970693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:04.970967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:04.972360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] RBAC: Adding query filter params (group.id=7e9c544326a94130920162b13ba2277f, role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=08712a2fc7d14bcea78d3e24178be8ca) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:04.972901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:04.975119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a9197-15e6-4db7-82d0-7d69e2a1aef4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:04.986639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 188/380] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:04 2022] GET /identity/v3/role_assignments?group.id=7e9c544326a94130920162b13ba2277f&scope.project.id=08712a2fc7d14bcea78d3e24178be8ca&role.id=71e577fde5844b97bf565dd6010625e6 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:05.052476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493252-8d57-400d-8794-d7d06fe6ae11 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:05.053084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493252-8d57-400d-8794-d7d06fe6ae11 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:05.053575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493252-8d57-400d-8794-d7d06fe6ae11 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:05.055563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 193/381] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:05.061415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da87a5-ce89-49e7-9f37-33118fb970ec None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:05.061697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da87a5-ce89-49e7-9f37-33118fb970ec None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:05.061972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da87a5-ce89-49e7-9f37-33118fb970ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:05.086736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b1da87a5-ce89-49e7-9f37-33118fb970ec None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:05.087937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b1da87a5-ce89-49e7-9f37-33118fb970ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:05.157811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:05.180940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 189/382] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:05.337641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bcdb2-97a8-4ee4-9059-32e314a27fc8 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:05.337842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bcdb2-97a8-4ee4-9059-32e314a27fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:05.338154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bcdb2-97a8-4ee4-9059-32e314a27fc8 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:05.340780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 194/383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:05.345880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:05.346164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:05.346436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:05.372075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:05.373272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:05.463796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 190/384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:05.637382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bcdb2-97a8-4ee4-9059-32e314a27fc8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:05.760140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bcdb2-97a8-4ee4-9059-32e314a27fc8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:05.806494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:05.807135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:05.807422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:05.807702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:05.823846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:05.829537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:05.830455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:05.831331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:05.834590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 195/385] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:05.836942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:05.987116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839f0b3-f4ef-46b7-9bf5-84e5645d8348 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.005988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.022832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:06.025491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:06.053016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.053634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.053913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.054185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.054876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] RBAC: Adding query filter params (name=member) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:06.055173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.056549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.073986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 191/386] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:06.092318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.154103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80354e-8d47-4203-9618-adae96bd25bf None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.195618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.196647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.197123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.197664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.210724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:06.217348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:06.218223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:06.219085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:06.222507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 196/387] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:06.228650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.265531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687c046-67c2-4d1b-9ece-c5fee642d9bd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.328646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.329303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.329579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.329849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.331917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:06.335358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.336842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.338828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 192/388] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:06 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:06.346102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.363621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed071e-3433-439c-acb1-e31d2e726b14 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.409100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.409964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.409964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.410227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.410908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:06.411204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.412874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.418924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:06.429013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 197/389] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:06.429895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.490533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe75ab7-66e2-404a-9996-0b9b1f19ab88 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.533623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.534626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.535101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.535567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.537327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.539319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.543149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 193/390] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:06 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:06.549001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.597488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e63a-a322-4ba9-9f29-0adcf738ae4d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.660678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.661312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.661586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.661879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.665050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17a016-b07c-43a1-87f3-89ccfb1dcadb None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.667718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.669264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.671132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 198/391] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:06 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:06.676533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.681795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:06.686392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:06.705859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.706999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.707525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.708070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.710258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28ef57275424d4ba1cf73e79fb16d45, group_id=4f8ba5ffce4046f286be69bc31364ab0, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.711990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.780266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 194/392] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 14 02:33:06 2022] PUT /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:06.809675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917b2e2-57d1-4c1e-833d-5350bd0a824a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:06.851229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b02a7-3bee-44c5-9e2d-6b97ba35f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:06.852287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b02a7-3bee-44c5-9e2d-6b97ba35f02c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:06.852817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b02a7-3bee-44c5-9e2d-6b97ba35f02c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:06.853301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b02a7-3bee-44c5-9e2d-6b97ba35f02c None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:06.854941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b02a7-3bee-44c5-9e2d-6b97ba35f02c None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:06.857159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b02a7-3bee-44c5-9e2d-6b97ba35f02c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:06.859638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:06 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:06.865052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:06.987217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82746d-8dea-4dcf-963c-4d6c697a7a57 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:07.025292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87616dd-c47c-4350-b3e0-c8df8c3bf939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:07.026398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87616dd-c47c-4350-b3e0-c8df8c3bf939 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:07.027427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87616dd-c47c-4350-b3e0-c8df8c3bf939 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:07.027895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87616dd-c47c-4350-b3e0-c8df8c3bf939 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:07.030443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87616dd-c47c-4350-b3e0-c8df8c3bf939 None admin] RBAC: Authorizing `identity:create_grant(project_id=a28ef57275424d4ba1cf73e79fb16d45, group_id=4f8ba5ffce4046f286be69bc31364ab0, role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:07.032190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87616dd-c47c-4350-b3e0-c8df8c3bf939 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:07.119609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 195/394] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 14 02:33:06 2022] PUT /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/9108424240854e83b07bba15a59c1a63 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:33:07.270932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f46e-e285-4112-ae7a-91fdea9f3303 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:07.271650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f46e-e285-4112-ae7a-91fdea9f3303 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:07.272121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57f46e-e285-4112-ae7a-91fdea9f3303 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:07.274081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 200/395] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:07.279697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b98777-deb1-45a9-ba07-6bcaa800ae36 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:07.280279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b98777-deb1-45a9-ba07-6bcaa800ae36 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:07.280831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b98777-deb1-45a9-ba07-6bcaa800ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:07.303736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-95b98777-deb1-45a9-ba07-6bcaa800ae36 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:07.305319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-95b98777-deb1-45a9-ba07-6bcaa800ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:07.337471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:07.386939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 196/396] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:07.642027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94eb9f-341b-471f-a18c-d6d4299feb8b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:07.642721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94eb9f-341b-471f-a18c-d6d4299feb8b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:07.643224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94eb9f-341b-471f-a18c-d6d4299feb8b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:07.645016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 201/397] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:07.649995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6049-f796-46e4-b36d-f7e8d46646fd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:07.650280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6049-f796-46e4-b36d-f7e8d46646fd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:07.650587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6049-f796-46e4-b36d-f7e8d46646fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:07.675541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-552a6049-f796-46e4-b36d-f7e8d46646fd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:07.676752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-552a6049-f796-46e4-b36d-f7e8d46646fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:07.768937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 197/398] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:07.773784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94eb9f-341b-471f-a18c-d6d4299feb8b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:07.898930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:07.940798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94eb9f-341b-471f-a18c-d6d4299feb8b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:07.996390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:07.997064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:07.997350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:07.997628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.008105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de16b8-b0da-4f07-8282-1172d9f495d1 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.008609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de16b8-b0da-4f07-8282-1172d9f495d1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.008707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de16b8-b0da-4f07-8282-1172d9f495d1 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.010149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 198/399] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:08.021014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:08.021940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.022230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.022520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:08.026657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:08.027550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:08.028336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 202/400] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:08.033870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.067478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:08.068681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:08.145815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1fe9-480e-4778-a16a-104210adf523 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.177036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:08.187466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.188070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.188340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.188600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.189262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:08.189557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:08.193952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:08.210162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 203/401] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:08.216937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.225416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 199/402] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:08.242564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.309681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:08.338360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae7e2b-24c7-4993-9868-770954bb7b97 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.378624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.379269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.379549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.379822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.381031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:08.382560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:08.384521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 204/403] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:08.390701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.484926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ffd52-b767-4001-b88a-e294767d2b88 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.503208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:08.540661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.541420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.541708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.542149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.546017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f9d5-de69-4b2f-849e-54633e0d36dd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.554524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:08.561331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:08.562291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:08.563110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:08.563728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 200/404] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:08.564270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.584849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.585814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.586315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.586847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.588201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:08.590527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:08.592765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 205/405] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:08.597960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.672549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:08.697388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16183c2f-e094-4254-8281-b3d0c3ad0536 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.702936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22272623-17aa-432c-9e2e-bf414a532586 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.741023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:08.743907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.744784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.745120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.745648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.745908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.746211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.746582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.746700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.747397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:08.747853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:08.749567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:08.759522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 206/406] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:08.760348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.761494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:08.768444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:08.770094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:08.770937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:08.771577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 201/407] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:08.772639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.889977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a51ca2-13d8-4c28-a937-1742223c0372 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.910297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922554d-a5cb-4f59-9e1b-c916a88558fc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:08.932002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.933049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.934314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.934898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.936752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:08.939167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:08.942324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 202/408] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:08.944043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:08.950525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:08.951332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:08.951683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:08.952072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:08.954275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] RBAC: Authorizing `identity:create_grant(project_id=171d79f90f4741afa66f6a552714da58, group_id=4f8ba5ffce4046f286be69bc31364ab0, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:08.956471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:08.962763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:09.047156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 207/409] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 14 02:33:08 2022] PUT /identity/v3/projects/171d79f90f4741afa66f6a552714da58/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:09.048477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:09.065535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0dd85-30bd-4238-9c76-15d6954abccb None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:09.150105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:09.150765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.152112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.152402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.153094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:09.153393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:09.157510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:09.169569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 203/410] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:09.176003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:09.190151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:09.258620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feed8c-92d2-4ba8-9529-dec977c410ae None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:09.306135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:09.306755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.307038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.307298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.309443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:09.311027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:09.313561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 208/411] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:09 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:09.322326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:09.324391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:09.376061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b692-b465-4dec-ae09-b9ccb25c7dcd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:09.435513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bcf64-493b-4c0d-81fd-66217a067ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:09.436514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bcf64-493b-4c0d-81fd-66217a067ede None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.436942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bcf64-493b-4c0d-81fd-66217a067ede None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.437371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bcf64-493b-4c0d-81fd-66217a067ede None admin] PATH_INFO: `/v3/groups/7e9c544326a94130920162b13ba2277f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.438810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bcf64-493b-4c0d-81fd-66217a067ede None admin] RBAC: Authorizing `identity:get_group(group_id=7e9c544326a94130920162b13ba2277f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:09.441028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bcf64-493b-4c0d-81fd-66217a067ede None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:09.444081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 204/412] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:09 2022] GET /identity/v3/groups/7e9c544326a94130920162b13ba2277f => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:09.445412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f7a-a7fe-464a-a7c0-fe333ecf5055 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.445842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f7a-a7fe-464a-a7c0-fe333ecf5055 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.446239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f7a-a7fe-464a-a7c0-fe333ecf5055 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.447605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 205/413] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:09.453372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.454515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.455004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.477698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:09.480273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:09.485500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19306-b064-4010-bb2c-ea155228a389 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:09.507395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:09.523836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:09.524918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.525404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.525872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.528439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=171d79f90f4741afa66f6a552714da58, group_id=4f8ba5ffce4046f286be69bc31364ab0, role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:09.530236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:09.566671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 206/414] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:09.568034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:09.629643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 209/415] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 14 02:33:09 2022] PUT /identity/v3/projects/171d79f90f4741afa66f6a552714da58/groups/4f8ba5ffce4046f286be69bc31364ab0/roles/9108424240854e83b07bba15a59c1a63 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:09.654811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:09.688108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992558f-5960-4ca1-bc84-6901bfa1e0ca None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:09.730387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9dccb-f867-4777-8806-6f98b5deaed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:09.731065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9dccb-f867-4777-8806-6f98b5deaed8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.731341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9dccb-f867-4777-8806-6f98b5deaed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.731668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9dccb-f867-4777-8806-6f98b5deaed8 None admin] PATH_INFO: `/v3/projects/08712a2fc7d14bcea78d3e24178be8ca` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.732872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9dccb-f867-4777-8806-6f98b5deaed8 None admin] RBAC: Authorizing `identity:get_project(project_id=08712a2fc7d14bcea78d3e24178be8ca)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:09.734324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9dccb-f867-4777-8806-6f98b5deaed8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:09.736683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 207/416] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:09 2022] GET /identity/v3/projects/08712a2fc7d14bcea78d3e24178be8ca => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:09.743772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:09.766251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbc1c-7a07-444d-8488-e92ea703db0a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.766251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbc1c-7a07-444d-8488-e92ea703db0a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.766251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbc1c-7a07-444d-8488-e92ea703db0a None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.766251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 208/417] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:09.773543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.773543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.773543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.798170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:09.799875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:09.901155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 209/418] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:09.902847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:09.915017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acc842-2d2e-4a07-87c5-37ceb24c65b9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:09.956692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:09.957358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:09.957635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:09.957906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] PATH_INFO: `/v3/projects/08712a2fc7d14bcea78d3e24178be8ca/groups/7e9c544326a94130920162b13ba2277f/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:09.962532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] RBAC: Authorizing `identity:create_grant(project_id=08712a2fc7d14bcea78d3e24178be8ca, group_id=7e9c544326a94130920162b13ba2277f, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:09.964557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:09.995913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:10.028648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428bfd2-e4b6-446b-bc90-aed578335a4b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:10.065897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 210/419] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Sep 14 02:33:09 2022] PUT /identity/v3/projects/08712a2fc7d14bcea78d3e24178be8ca/groups/7e9c544326a94130920162b13ba2277f/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:10.066117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:10.066771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:10.067054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:10.067328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:10.081177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:10.086573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:10.087470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:10.088686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 210/420] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:10.095645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:10.185947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:10.268426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde97b-04ea-4ba9-a9d0-49ff98faa57b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:10.307997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:10.324112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:10.324783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:10.325063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:10.325337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:10.326326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:10.326659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:10.328307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:10.344640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 211/421] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:10.347208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:10.511799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a18be1-6199-49c1-8f78-3e33083d5fa9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:10.514312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:10.550261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0f43c-994e-4531-871c-d54f2abada35 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:10.584572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:10.584960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:10.585194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:10.585476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:10.585744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:10.600634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:10.601279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:10.601563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:10.601837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:10.620930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:10.626654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:10.627644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:10.628427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 211/422] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:10.641647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:10.717883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:10.719859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:10.841860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc4f58-9cba-4077-ad00-bbfc92213f22 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:10.845748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 212/423] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:10.851898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:10.855854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:10.915181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:10.915799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:10.916092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:10.916329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:10.916997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:10.917531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:10.918952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:10.937193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 212/424] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:10.948219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:10.965896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910dc8e-6e41-49a0-9d20-a3f060e96ff1 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:11.004223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:11.005310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.005785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.006273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.007686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:11.009321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:11.012360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 213/425] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:10 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:11.018029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:11.102384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:11.102903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:11.138454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef755-cdd1-495f-83dd-6206a6c67291 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:11.177112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:11.178105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.178653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.179125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.180463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:11.182075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:11.185280 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 214/426] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:11 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:11.193713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:11.212380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e610bb2-3f12-4dd2-8439-0d218c8aac74 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:11.248832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac813121-ec31-400d-bc87-c652c5448e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:11.249439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813121-ec31-400d-bc87-c652c5448e02 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.249714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813121-ec31-400d-bc87-c652c5448e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.249978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813121-ec31-400d-bc87-c652c5448e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.330562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd23c7-d464-4892-b7f6-a60e3d3e4799 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:11.369095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac813121-ec31-400d-bc87-c652c5448e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:11.371500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac813121-ec31-400d-bc87-c652c5448e02 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:11.373899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:11.374531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.374810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.375823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.375823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:11.376120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:11.377475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:11.384004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 215/427] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:11 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:11.430677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:11.510418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 213/428] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 02:33:11.517041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:11.521411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:11.633892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86165a-55fe-418a-95c7-1cba41e6f315 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:11.643194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef228b7c-c343-4b85-85c9-67dd82c95164 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.643628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef228b7c-c343-4b85-85c9-67dd82c95164 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.644045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef228b7c-c343-4b85-85c9-67dd82c95164 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.646094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 214/429] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:11.651617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.651909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.652200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.681257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:11.681787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:11.682434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.683318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.683563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:11.683735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] PATH_INFO: `/v3/projects/a28ef57275424d4ba1cf73e79fb16d45` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.685131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] RBAC: Authorizing `identity:get_project(project_id=a28ef57275424d4ba1cf73e79fb16d45)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:11.686803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:11.689730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 216/430] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:11 2022] GET /identity/v3/projects/a28ef57275424d4ba1cf73e79fb16d45 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:11.695983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:11.785234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 215/431] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:11.802443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:11.834426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f41d8-ef5c-4ee0-9193-8ac5dc902447 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:11.874406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:11.875153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:11.875434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:11.875704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:11.876842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:11.878256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:11.880167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 217/432] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:11 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:11.885723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:11.986765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:12.012240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a64b8-844b-4c50-ae7e-7cb3add35629 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:12.051078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:12.051689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.051963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.052234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.052965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=a28ef57275424d4ba1cf73e79fb16d45) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:12.053268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:12.054724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:12.064107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 216/433] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:11 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=a28ef57275424d4ba1cf73e79fb16d45&role.id=9108424240854e83b07bba15a59c1a63 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:12.144396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:12.274644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5626a-0bad-4291-a2f7-ae1d9fb29e9f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:12.314006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9921e7a-3a5a-412b-b4e9-01badfd36cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:12.314674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9921e7a-3a5a-412b-b4e9-01badfd36cec None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.314957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9921e7a-3a5a-412b-b4e9-01badfd36cec None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.315231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9921e7a-3a5a-412b-b4e9-01badfd36cec None admin] PATH_INFO: `/v3/roles/member` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.322924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:12.328509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9921e7a-3a5a-412b-b4e9-01badfd36cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c9921e7a-3a5a-412b-b4e9-01badfd36cec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:12.333603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:12.335853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:12.337258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 218/434] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:12.341850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:12.369766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4ade-78fc-4613-b3e1-33afed1e8962 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.370065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4ade-78fc-4613-b3e1-33afed1e8962 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.371019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4ade-78fc-4613-b3e1-33afed1e8962 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.373118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 219/435] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:12.380445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.380865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.381239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.404882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:12.406036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:12.472229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fcf62-6a68-475a-871c-7a0abf34a315 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:12.489565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 220/436] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:12.511473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:12.512169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.512448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.512721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.513385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:12.513691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:12.515377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bdb55-8e1b-49c9-9620-e238c55ed6a6 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:12.524283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 217/437] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:33:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:12.529973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:12.645618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d689-2d5d-48d3-8a96-83a5ecfe20f0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:12.666258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0271-ec70-46e4-9dca-aa1c37101e59 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.666518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0271-ec70-46e4-9dca-aa1c37101e59 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.666757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0271-ec70-46e4-9dca-aa1c37101e59 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.668902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 218/438] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:12.674013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.674295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.674610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.677404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:12.686598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:12.687218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.687495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.687763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.694058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:12.701284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:12.701284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:12.761205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:12.763158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:12.764804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 219/439] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:12.768782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:12.875440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0af2b-3b40-4c89-804a-7d633672eb44 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:12.877685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 221/440] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:12.878854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:12.911967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:12.912840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:12.913456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:12.913737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:12.914009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:12.922842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:12.926448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:12.931607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:12.932493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:12.934450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:12.943453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 220/441] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:12.943453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:12.996790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8a3dc-e9a1-4d12-b5b2-68b1a7e323e4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.034731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.035364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.035644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.035916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.037042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.038489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.040121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 222/442] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:12 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:13.040878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.049416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312edf-d2d7-4550-9e5b-e20f22af40f0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.083458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.084055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.084333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.084606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.085274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:13.085574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.086988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.100027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 221/443] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:13.100027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.137665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.143493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b58123-ed3e-483d-8ab6-37cf9d97e830 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.157918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.176950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.177508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.177783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.178045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.188340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:13.193150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:13.194142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 223/444] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:13.195499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.199128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f5c68-cc16-4ed7-8d7d-a2a8abddb925 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.233849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.234501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.234782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.235056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.236173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.237637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.239238 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 222/445] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:13.239994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.295843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3503ca-2ec6-4892-8b3f-8543a0cf155c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.328709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.329301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.329578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.329848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.338932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361620e1-8d84-472d-93be-a9ff25d7a3ec None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.353721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.365114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.373201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.373802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.374090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.374367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.375054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:13.375359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.376820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.385102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 223/446] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:13.385920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.397546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.399048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.483413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77aeeb-2073-46e5-81e0-646cfc115d2c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.495034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 224/447] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:13.495932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.517112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.517704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.518029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.518303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.519063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=bde60ff36c1749398f883222ee4c5e23, scope.project.id=171d79f90f4741afa66f6a552714da58) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:13.519368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.520825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.527037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 224/448] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=bde60ff36c1749398f883222ee4c5e23 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:13.527746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.565357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.595789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.615897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebf64-d65c-4fb0-aee4-01e040022cd3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.651202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e1d8-bdf9-4213-a06b-684cf157c1fd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.656165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.656874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.657228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.657575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.695501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.696144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.696425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.696698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] PATH_INFO: `/v3/projects/171d79f90f4741afa66f6a552714da58` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.699642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=171d79f90f4741afa66f6a552714da58)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.701200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.706623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 225/449] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/projects/171d79f90f4741afa66f6a552714da58 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:13.709488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.744100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.744730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.811918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.832022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c1a9-4fb1-4709-a887-f40adaa6d3a8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:13.860181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:13.863369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 225/450] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:13.869193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.878082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:13.879010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:13.879292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:13.879569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] PATH_INFO: `/v3/groups/4f8ba5ffce4046f286be69bc31364ab0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:13.881446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] RBAC: Authorizing `identity:get_group(group_id=4f8ba5ffce4046f286be69bc31364ab0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:13.883319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:13.885532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 226/451] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/groups/4f8ba5ffce4046f286be69bc31364ab0 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:13.895578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:13.988804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af67f-8984-44a1-b92f-dd947135bb0b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:14.010104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3365cd-549b-489e-8517-4efe9b1b8f82 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:14.029646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:14.030267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:14.030573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:14.030843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] PATH_INFO: `/v3/projects/08712a2fc7d14bcea78d3e24178be8ca` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:14.031950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] RBAC: Authorizing `identity:get_project(project_id=08712a2fc7d14bcea78d3e24178be8ca)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:14.033394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:14.035218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 226/452] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/projects/08712a2fc7d14bcea78d3e24178be8ca => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:14.040367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:14.045091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:14.045686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:14.045962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:14.046231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:14.046981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] RBAC: Adding query filter params (group.id=4f8ba5ffce4046f286be69bc31364ab0, role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=171d79f90f4741afa66f6a552714da58) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:14.047288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:14.048711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:14.054919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 227/453] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:13 2022] GET /identity/v3/role_assignments?group.id=4f8ba5ffce4046f286be69bc31364ab0&scope.project.id=171d79f90f4741afa66f6a552714da58&role.id=9108424240854e83b07bba15a59c1a63 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:14.071799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:14.151647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb69aa-091f-4b45-be7a-c4d58ef125f2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:14.189549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4cd2f-9145-49ad-ad95-52b59786b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:14.190236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4cd2f-9145-49ad-ad95-52b59786b40b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:14.190460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4cd2f-9145-49ad-ad95-52b59786b40b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:14.190767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4cd2f-9145-49ad-ad95-52b59786b40b None admin] PATH_INFO: `/v3/groups/7e9c544326a94130920162b13ba2277f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:14.191959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4cd2f-9145-49ad-ad95-52b59786b40b None admin] RBAC: Authorizing `identity:get_group(group_id=7e9c544326a94130920162b13ba2277f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:14.193457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4cd2f-9145-49ad-ad95-52b59786b40b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:14.195107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 227/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Sep 14 02:33:14 2022] GET /identity/v3/groups/7e9c544326a94130920162b13ba2277f => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:14.201378 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:14.264692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:14.309756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02cdbd-9d3a-4037-9617-fe554d6911d7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:14.343594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:14.344188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:14.344462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:14.344727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:14.345447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] RBAC: Adding query filter params (group.id=7e9c544326a94130920162b13ba2277f, role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=08712a2fc7d14bcea78d3e24178be8ca) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:14.345748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:14.347196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fb21-bc9e-4e75-ab90-e19268b30495 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:14.352945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 228/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Sep 14 02:33:14 2022] GET /identity/v3/role_assignments?group.id=7e9c544326a94130920162b13ba2277f&scope.project.id=08712a2fc7d14bcea78d3e24178be8ca&role.id=71e577fde5844b97bf565dd6010625e6 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:17.037104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2067dac-8f20-477c-8cb3-b180e5371d07 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.037647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2067dac-8f20-477c-8cb3-b180e5371d07 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.037647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2067dac-8f20-477c-8cb3-b180e5371d07 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.039269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 228/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:17.051693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b0676-c6e0-46b5-895c-53c0156cb392 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.052505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b0676-c6e0-46b5-895c-53c0156cb392 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.053001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b0676-c6e0-46b5-895c-53c0156cb392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.083657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e64b0676-c6e0-46b5-895c-53c0156cb392 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:17.085245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e64b0676-c6e0-46b5-895c-53c0156cb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:17.172232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 229/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:17.378889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b5699-0e1a-4821-8ba2-7e6e05ce475b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.379078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b5699-0e1a-4821-8ba2-7e6e05ce475b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.379351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b5699-0e1a-4821-8ba2-7e6e05ce475b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.380960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 229/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:17.385872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.386129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.386399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.413560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:17.414794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:17.452954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975693-91d0-4b18-8e16-db649ea4b5de None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.453571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975693-91d0-4b18-8e16-db649ea4b5de None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.454285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975693-91d0-4b18-8e16-db649ea4b5de None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.456744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 230/459] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:17.466942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:17.472722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.473351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.474161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.505089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 230/460] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:17.506035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:17.507271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:17.581866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:17.625874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 231/461] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:17.721162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b20f-e113-4bf6-a8bc-68ba53ad3abb None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:17.756050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:17.756980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.757435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.757883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.769062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:17.770762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:17.785857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:17.786834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:17.787693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:17.787693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:17.787693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:17.787866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:17.789764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 231/462] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:17.802039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:17.833536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:17.850561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:17.924646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b63a61-20dc-4667-819b-4f395c666a9d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:17.929139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08681c79-856c-4bab-9ba6-7494e759d5fc None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:17.960896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:17.961695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.961920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.962272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.963009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:17.963386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:17.965087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e326a9-5883-4d8f-96f2-bf4a1db10ffe None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:17.971354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:17.972240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.973153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.973604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.982501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 232/463] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:17.982501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e243-a13e-471b-9c3c-55a905235dfd None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.982501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e243-a13e-471b-9c3c-55a905235dfd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.982501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e243-a13e-471b-9c3c-55a905235dfd None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.987069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 233/464] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:17.988370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:17.988603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:17.988974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:17.992340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:17.994200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.007900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:18.009107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:18.016917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:18.017830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:18.018719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:18.018719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:18.018719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:18.018896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 232/465] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:18.022624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.102505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 234/466] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:18.102505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.108692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:18.130664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:18.134560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac697a-3e98-4252-a0da-5dec10e960e9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.182010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.183656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.184116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.184426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.185994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.187509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.217432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90de2d-8445-46bc-b903-71588192d4de None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.255212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.255829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.256115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.256390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.268139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.269573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:18.288021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:18.288963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:18.289787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:18.289787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:18.289787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:18.289787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 235/467] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:18.290001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.314961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 233/468] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:33:18 2022] POST /identity/v3/users => generated 246 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:18.319531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.383804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:18.421596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee20c1-bcab-4c3d-ad95-e9bdb62938ae None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.462414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.463397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.464525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.465064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.466010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:18.466562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.468195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.481656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 236/469] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:18.482984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.490314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22234039-2616-4f47-a826-6e22f1fd6688 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.530178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:18.536598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.537247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.537496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.537778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.538584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:18.538897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.540574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.560260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 234/470] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:18.561313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.608370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416589c0-f214-4736-b0ac-7b61f4169e61 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.640725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:18.647060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.647707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.647988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.648258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.659865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.661396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.682068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed8bc8-f24e-458d-b23e-714ea040c734 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-692c48d5-decf-4946-825f-05d3344b0c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:18.682652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:18.683633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:18.684456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:18.684456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:18.684456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:18.684456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 237/471] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:18.685247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56406-a6f9-4e4e-9d66-b0b87d8c1318 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.685247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56406-a6f9-4e4e-9d66-b0b87d8c1318 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.685516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf56406-a6f9-4e4e-9d66-b0b87d8c1318 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.686869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 238/472] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:18.687397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56406-a6f9-4e4e-9d66-b0b87d8c1318 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:18.728941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d72590-7fb0-41ec-b81d-dcee6ba884c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.729544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d72590-7fb0-41ec-b81d-dcee6ba884c7 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.730376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d72590-7fb0-41ec-b81d-dcee6ba884c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.730681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d72590-7fb0-41ec-b81d-dcee6ba884c7 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.731338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d72590-7fb0-41ec-b81d-dcee6ba884c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.732777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d72590-7fb0-41ec-b81d-dcee6ba884c7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.800396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf56406-a6f9-4e4e-9d66-b0b87d8c1318 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:18.838878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:18.839869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.840279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.840680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.841604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:18.843087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:18.873317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 235/473] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:33:18 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:18.874669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:18.874960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:18.875286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:18.896407 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:18.899156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:18.947310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:18.959807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 239/474] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:33:18 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:18.961058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:19.002156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 236/475] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:19.020082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:19.108531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6db77-10cc-4c02-9310-286c52e9faa0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:19.150864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:19.152107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:19.152382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:19.152653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:19.153316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:19.153615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:19.155136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:19.169919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 240/476] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:19.175367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:19.288334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1773-ffc5-475e-965b-bbbbc4571a1d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:19.327641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:19.328307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:19.328592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:19.328863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:19.329525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:19.330981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:19.348365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:19.410357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 237/477] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:33:19 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:33:19.468954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:19.472167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4e666-8264-4f16-807d-d2ad8ee5d79f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:19.514092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:19.514987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:19.515264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:19.515534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:19.516221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:19.517668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:19.555362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.sql.core [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 02:33:19.555362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 02:33:19.555362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [parameters: {'id': 'cd7560ea3cc841e9a6e0aadbca68f20c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 02:33:19.555362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application conn.query(q) Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result.read() Sep 14 02:33:19.586674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return ref.to_dict() Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 02:33:19.587677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application next(self.gen) Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application yield resource Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application next(self.gen) Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise self.value Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application session.commit() Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 02:33:19.588586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.session.flush() Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application compat.raise_( Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 02:33:19.590018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 02:33:19.596300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application conn.query(q) Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result.read() Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 02:33:19.598185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [parameters: {'id': 'cd7560ea3cc841e9a6e0aadbca68f20c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:19.600194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 02:33:19.602089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:19.605986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 241/478] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 14 02:33:19 2022] POST /identity/v3/roles => generated 144 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:19.611695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:19.671923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:19.755809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0defddb-188c-493c-ac02-54183980a214 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:19.794174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5833d-5a58-4ea2-b581-5aa507517284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:19.794844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5833d-5a58-4ea2-b581-5aa507517284 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:19.795121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5833d-5a58-4ea2-b581-5aa507517284 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:19.795388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5833d-5a58-4ea2-b581-5aa507517284 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:19.806155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5833d-5a58-4ea2-b581-5aa507517284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-0bb5833d-5a58-4ea2-b581-5aa507517284 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:19.811562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:19.813614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:19.815596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 238/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:33:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:19.822575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:19.966252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f7d3d-e45f-4ff0-977a-eea233269f7e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:20.032224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:20.033016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:20.033302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:20.033577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:20.034265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:20.034595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:20.036001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329501a-0044-4b65-967d-4ffd4c840cd0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:20.049384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 242/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:20.754080 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258840-2197-4de6-aebd-0a98a8edb9c2 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:20.754645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258840-2197-4de6-aebd-0a98a8edb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:20.754645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258840-2197-4de6-aebd-0a98a8edb9c2 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:20.756238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 239/481] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:20.765515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:20.766344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:20.766900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:20.795460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:20.797018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:20.818746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:20.877858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 243/482] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:21.349961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258840-2197-4de6-aebd-0a98a8edb9c2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:21.482081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:21.496553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258840-2197-4de6-aebd-0a98a8edb9c2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:21.541386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021cd06-d25d-4e03-8a23-253933b38a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:21.542599 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021cd06-d25d-4e03-8a23-253933b38a1c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:21.542947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021cd06-d25d-4e03-8a23-253933b38a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:21.543213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021cd06-d25d-4e03-8a23-253933b38a1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:21.561352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021cd06-d25d-4e03-8a23-253933b38a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-d021cd06-d25d-4e03-8a23-253933b38a1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:21.566227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:21.567134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:21.567930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 240/483] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:21.574152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:21.591932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd989f2-2ac8-4b32-a92d-579e0e169a91 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:21.592197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd989f2-2ac8-4b32-a92d-579e0e169a91 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:21.592485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd989f2-2ac8-4b32-a92d-579e0e169a91 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:21.595381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 241/484] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:21.604943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:21.604943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:21.604943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:21.630760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:21.632361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:21.698001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e35ea-343d-4370-9855-fa74ebe77652 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:21.713470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 242/485] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:21.737290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:21.738287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:21.738811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:21.739282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:21.740146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:21.740662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:21.742268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72cc00-ffcb-4ee9-abc2-967b6efafeb3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:21.752444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 244/486] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:21.758544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:21.875467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981830c7-ad06-4d0d-b45c-5bab705622cc None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:21.876470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981830c7-ad06-4d0d-b45c-5bab705622cc None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:21.876964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981830c7-ad06-4d0d-b45c-5bab705622cc None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:21.878556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 245/487] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:21.886428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:21.886428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:21.886428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:21.899603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:21.905767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:21.907577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:21.938319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:21.942860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722548a5-2cd9-4aae-aa45-d1e7d001afd4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.013906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.016395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.017196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.019367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.037635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.039136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.047559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 246/488] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:22.048873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:22.054850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:22.056914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:22.058614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:22.058614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:22.058614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:22.058614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 243/489] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:22.065865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.175005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f22e8-d38d-4cbf-adda-114a5be7ca93 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.188727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9b818-e97f-43a0-bfd7-1d3a9b44635d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.209880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.210313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.210636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.210902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.211540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:22.211838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.213187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.215062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:22.226057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 244/490] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:22.235548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.236478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.236948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.237407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.239527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.263459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:22.268637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:22.269491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:22.270285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:22.278905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 247/491] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:22.293651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.312796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:22.350750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed9f51-3a12-4e61-b886-51a764bf7839 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.392133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.392767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.393045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.393310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.401086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.403453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:22.418645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:22.419609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:22.420541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 245/492] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:22.427250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.492420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61be61c-67b6-40ba-8611-62f22a6beb58 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.513621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:22.529831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.530588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.530922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.531252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.531981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:22.537980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.537980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.542876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 248/493] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:22.543759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.564877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bbf03-2a22-4f88-8103-19f0a5d23a84 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.602865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.603904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.604185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.605048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.605771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:22.606073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.607547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066544ef-534f-46f0-b814-62c47c43c58b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.611686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:22.644667 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714753af-491c-42a3-86e9-c8abf394ef63 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.647209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 246/494] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:22.648529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dabd1-af61-42af-a0ed-c8414bd9b0f0 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.648817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dabd1-af61-42af-a0ed-c8414bd9b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.649068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dabd1-af61-42af-a0ed-c8414bd9b0f0 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.650412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 247/495] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:22.651019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dabd1-af61-42af-a0ed-c8414bd9b0f0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.691798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.692341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.692618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.692916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.703243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:22.708522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:22.709430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:22.710252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 249/496] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:22.710943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:22.765749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dabd1-af61-42af-a0ed-c8414bd9b0f0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.780162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:22.804310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.805206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.805638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.805908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.816595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.818771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.824478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83e85-fbfd-4fe0-8f04-30ffa878b859 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e30c5ec7-cd86-48f2-a8f0-c51f41e5722d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:22.835327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:22.836214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:22.837067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:22.837067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:22.837067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:22.837067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 248/497] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:22.838073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.838073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.838073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.857644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:22.857818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:22.859687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:22.863348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:22.863953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:22.864286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:22.864513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:22.934267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:22.935870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:22.953259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 249/498] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:22.953259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.053076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 250/499] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:23.054092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.083619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.086531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.087484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c13ef3-76d4-409a-87c9-d18bc09a5046 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.123233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.123844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.124125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.124399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.125061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:23.125364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.126758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2f75-fda6-436d-920e-5b02291e878a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.140186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 250/500] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:23.140186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc6b2-44cb-4601-964a-b93c3a400e6d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.140186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc6b2-44cb-4601-964a-b93c3a400e6d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.140186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc6b2-44cb-4601-964a-b93c3a400e6d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.140186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 251/501] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:23.140186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc6b2-44cb-4601-964a-b93c3a400e6d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.167427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e9ca-be1f-4340-a23e-46f79736e0e3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.201113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.201706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.201980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.202252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.202930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:23.203229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.204652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.219843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 251/502] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:23.219843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.250020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc6b2-44cb-4601-964a-b93c3a400e6d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.285642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.286262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.286567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.286841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.297789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.299245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-ee8312b3-07f6-4f82-a202-63d1f39b6f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:23.313590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:23.314713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:23.315579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:23.315579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:23.315579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:23.315745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.315818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 252/503] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:23.315818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.316529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.316529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.326731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45df92-2e84-4e8a-8289-8ebc8dfbe6d1 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.335586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:23.336832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:23.338816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.361055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.361683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.361959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.362227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.373821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.375444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:23.390598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:23.391688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:23.392757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:23.392757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:23.392757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:23.392757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 252/504] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:23.392757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.407423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 253/505] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:23.408334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.503186 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e449a-81f5-4ff3-9de0-7c08348a47f0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.515400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f72a51-34f5-4b15-8706-d2e7f9b1bea7 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.539209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.539902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.540246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.540590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.548634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.550086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.551411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.552132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.552502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.552864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.560455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:23.563227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:23.564290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 253/506] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:23.565407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.568793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.571392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:23.576914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:23.583233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 254/507] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:23.584032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.677883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba2a8-58cf-485d-a95d-ff1befd3a65d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.687519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4ad4-05f3-486f-82cc-603c0f002b40 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.712160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.712758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.713043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.713317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.714610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:23.714921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.716298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.721088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.721690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.721969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.722234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.722908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:23.723207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.724538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.727858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 254/508] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:23.728649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.742094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 255/509] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:23.742094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.789568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.795965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:23.828446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf4ac-27be-4e58-ae29-0cdfed7a2ca5 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.836419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5676889-dca3-42f8-9875-f8c15a11fb93 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:23.863267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.863868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.864144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.864416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.865141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:23.865445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.866939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.870328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:23.870996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:23.871277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:23.871545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:23.872193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:23.872494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:23.873818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:23.881555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 256/510] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:23.882325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.904681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 255/511] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:23.905822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:23.985525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd231cc6-e5b3-418e-8bcb-93b2562377dd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.005094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.006558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a58e33-ff98-4cb7-9b97-11d41ede6cb8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.019011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.019640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.019925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.020197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.026810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.030455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.031922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.040233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.040798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.041074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.041342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:24.046890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:24.047867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:24.051433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:24.051433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:24.051433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:24.051433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 257/512] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:24.051433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.051723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.053444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:24.069165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:24.070112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 256/513] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:24.071306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.152783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bda7a-f47e-498d-b46a-8bbdc4b3fc54 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.174283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823722b2-a2c4-4a35-8a09-e7ccfe83757f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.185182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.185793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.186065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.186334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.193529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.194982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:24.205756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:24.206706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:33:24.207610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:24.208254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.208349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 258/514] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:24.208416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.208416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.208531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.208595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.222081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.223575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:24.238037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:24.239069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:24.239930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:24.239930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:24.239930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:24.239930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 257/515] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:24.239930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.247552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.275580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.315224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f030-c762-4e97-a408-c923b9d20aa9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.343558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8471-a128-4f68-b835-97d27b9b38da None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.348775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.349376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.349655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.349927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.381312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.381908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.382189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.382458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.383135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:24.383433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.384807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.396675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 258/516] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:24.397468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.423750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.425281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.455342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.487832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.496367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2ca7-56bf-499f-8cdf-9e087ee1a3fc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.522472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 259/517] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:24.523333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.530535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.531135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.531412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.531678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.532356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:24.532655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.534092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.551682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 259/518] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:24.555352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.620406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e92e23-96a3-486e-9124-4e275a782719 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.649788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.651878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30d5c3-2016-4fcd-99fa-3c18bfe194a9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.655027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.655706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.656055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.656397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.657185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:24.657580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.659119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.676420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 260/519] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:24.677810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.685288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.685908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.686163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.686432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.687086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:24.687384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.688751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.700408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 260/520] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:24.701181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.715339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.780663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a0870-3739-47b1-afb0-65c62b3f23b3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.799338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a597c-ca98-464d-be19-b939cd48eab1 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.815114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.815710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.815984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.816250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.816879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.818290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.832617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:24.833230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:24.833506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:24.833776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:24.844398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:24.849311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:24.859961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:24.860998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:24.861839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:24.861839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:24.861839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:24.861839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 261/521] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:24.861839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.921729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:24.924744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 261/522] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:33:24 2022] POST /identity/v3/users => generated 247 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:24.925602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:24.961760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b42bc0-994f-4bfa-a245-46d7a0d0d89e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:24.988846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.013121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.013860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.014146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.014713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.015460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=aab0aa1e574a4549a1643bf0674df5c4) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:25.015772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.017246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.034726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 262/523] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/role_assignments?user.id=aab0aa1e574a4549a1643bf0674df5c4&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:25.034726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.068611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb9357-013a-4a50-b7a4-bacda46e2eb6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.133933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.134602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.134884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.135156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.183918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53244dbf-204d-4b0f-bc8c-b14628f00cc5 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.221878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.230574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.237113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.237259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.237349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.237349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.237349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.243717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.245520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:25.258420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:25.259483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:25.260369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 263/524] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:25.261500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.290154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.351012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 262/525] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:25.352207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.409983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd2ac-72be-4f5b-ab1c-6285eb5ed070 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.449644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.450588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.451048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.451497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.452372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:25.452950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.454650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.468427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 264/526] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:25.469597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.487888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0372097-5e13-449e-87f5-51042c553262 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.529069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.532896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.533516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.533795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.534068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.535291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:25.535602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.537354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.566438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 263/527] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:25.566438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.567629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.599379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d57b2-d7fa-4ba0-b877-c5a1d02c58d4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.637551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.638542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.639029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.639758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.650358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.652621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:25.668790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:25.669718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:25.670992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:25.670992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:25.670992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:25.672924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 265/528] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:25.673904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.697587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdab2f4-0e73-4dd0-8c14-3b7e365d6bf0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.739535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.740096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.740378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.740653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.751828 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.753904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:25.771462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:25.772396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:25.773255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:25.778984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 264/529] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:25.779467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:25.802736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.806847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9824f9-31ec-4af2-9dc4-684cdd6412d3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.848401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.849441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.849958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.850575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.854180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:25.905980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb51b4-80dd-4043-a8a9-91e5659af1a7 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:25.931583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.934442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.950885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:25.951517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:25.951797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:25.952071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:25.952729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:25.953033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:25.954923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:25.973258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 265/530] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:25.974184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.046404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:26.056231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 266/531] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:26.063008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.095433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129fa41-2eb9-4e96-a189-6431fc546186 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.120528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:26.131522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.132145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.132436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.132680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.133362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:26.133667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.135113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.159618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 266/532] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:26.159618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.185539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ab3eb-0b40-41e6-a159-15e615492f0d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.224406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.225544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.226028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.226666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.234871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.236678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:26.249338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:26.250205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:26.251098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:26.253629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 267/533] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:26.254759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.262891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0914e-ebcb-4bb6-89c5-446ad0475fa9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.305525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.307132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.308256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.308765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.324153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.325370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:26.327772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:26.348412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:26.349382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:26.350223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:26.350223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:26.350223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:26.356795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 267/534] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:26.356795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.378324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011796-e665-4d6b-8833-00401a8d5eac None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.409326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:26.420922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.425643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.425643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.425643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.425643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=27f39b9d908644379d12e3e0b4fc4635) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:26.425643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.425643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.435225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 268/535] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/role_assignments?user.id=27f39b9d908644379d12e3e0b4fc4635&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:26.435225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.494568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27558-296b-4969-a757-07fadda4b4c1 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.537174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.538220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.538741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.539904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.540999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:26.541867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.543680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.559156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 268/536] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:26.568662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.657663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4826e-dd51-4733-b972-d6c7246a7c6e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.691732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:26.704220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.704941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.705224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.705495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.711556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:26.711556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.711556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.723027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:26.728086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 269/537] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:26.729315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc9880-03a9-49df-ae5d-342644ea7319 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.731555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:26.795063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.796133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.796614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.797076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.798014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=d1aaf929efbc4f818d2f0b133d449f5d) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:26.798557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.800179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.812083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 269/538] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/role_assignments?user.id=d1aaf929efbc4f818d2f0b133d449f5d&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:26.894380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d9ed5-7bc4-47d5-bb5e-c641a0de917c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:26.932670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:26.933328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:26.933607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:26.933879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:26.941573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:26.943069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:26.956098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:26.956995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:26.958267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 270/539] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:26.965042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:27.126557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362014a-1ff1-494c-8c5c-8a3bf1b7dc34 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:27.185627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:27.186702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.187179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.187643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:27.188542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:27.189053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:27.190735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af5268-0651-4c70-b5ac-9f1493cf7e2e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:27.208708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 270/540] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:27.215868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:27.285951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed80fd6-a470-4569-aff0-7c436a0379b6 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.286281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed80fd6-a470-4569-aff0-7c436a0379b6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.286554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed80fd6-a470-4569-aff0-7c436a0379b6 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:27.288211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 271/541] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:27.292052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:27.297836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.298134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.298406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:27.339733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:27.341343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:27.377240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:27.388856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fbe9a-c72d-4f2a-8e00-c3141daeb0de None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:27.425114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:27.425726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.426009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.426282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:27.427117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=33c2eed340e0484880b561af4084ab7f) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:27.427430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:27.428869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756fc6e-4ed3-46c2-bd60-657cb9fb77bf None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:27.438845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 271/542] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:27 2022] GET /identity/v3/role_assignments?user.id=33c2eed340e0484880b561af4084ab7f&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:27.438845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c39a4-a0ff-472d-a291-21454c8ada66 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.438845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c39a4-a0ff-472d-a291-21454c8ada66 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.438845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c39a4-a0ff-472d-a291-21454c8ada66 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:27.438845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 272/543] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:27.444074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.444514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.444939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:27.460669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 272/544] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:27.466513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:27.468039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:27.551442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 273/545] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:27.842887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:27.913908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:27.958220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e11a2-5346-4e0d-ba10-90aede7655d8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:27.977693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:27.993548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:27.994279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:27.994444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:27.997483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.018229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:28.023198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:28.024079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:28.025202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 273/546] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:28.036290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.058951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:28.122896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e236fa-fa66-4566-993b-61fa4488d84a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.156062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903d796-29b6-4a07-a279-73967193dc31 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.191098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.192067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.192464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.192831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.193586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:28.194007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:28.195487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:28.196264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.197158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.197570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.198771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.208960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 274/547] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:28.216035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.228794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:28.234346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:28.235239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:28.237158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 274/548] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:28.245677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.371231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:28.392040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:28.395765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3986a8c-749c-4688-ac37-8841dfcfa3a3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.429146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6a2de-5cf8-4587-8808-32cd3bd5b09c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.454279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.455243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.455673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.456294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.457122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:28.457429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:28.459316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:28.475203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 275/549] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:28.482099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.492209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.492848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.493121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.493391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.509411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:28.511435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:28.530142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:28.531104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:28.532374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:28.532374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:28.532374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:28.532374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 275/550] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:28.538338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.619833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e19fc-4dad-420c-93af-3ac67bbb10dd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.679521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.680146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.680419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.680686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.706665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:28.708120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:28.726943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:28.729087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:28.731334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:28.731334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:28.731334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:28.731334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 276/551] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:28.739634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.760592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c898a82-e29c-4646-b138-3a6bcc2db6cd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.771738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:28.804229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:28.824529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.825133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.825408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.825674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.826321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:28.826648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:28.828051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:28.848868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 276/552] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:28.852876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:28.927682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726790-ceaa-4697-998f-146c60854e46 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:28.993619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:28.994140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:28.996487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:28.996953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:28.997785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:28.998232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.001010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.020866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0022893-a709-4b1d-82d6-13e79090cf0a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.027035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 277/553] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:29.037538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.098505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.099162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.099670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.099942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.110319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.111891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:29.125512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:29.126459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:29.127436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 277/554] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:29.132235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.175172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:29.208311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:29.229898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20f10-c0b0-4289-a6b3-4e7a23d0571a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.281360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b34b9-c467-4694-89f2-bbbfdeaafdfc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.291160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.291814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.292748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.293016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.301819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.303792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-75d2e348-27ce-4ce0-b64c-24f237a510a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:29.316882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:29.317799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:29.319210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:29.320276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 278/555] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:29.321696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e4f9c-e0d0-4a20-9aa3-a7fc78a477a6 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.321975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e4f9c-e0d0-4a20-9aa3-a7fc78a477a6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.322242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e4f9c-e0d0-4a20-9aa3-a7fc78a477a6 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.323671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 279/556] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:29.325080 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.325911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.326437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.326926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.327848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:29.328176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e4f9c-e0d0-4a20-9aa3-a7fc78a477a6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.328727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.330373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b00f8-38b1-4276-a7e2-0bf88caa1520 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.349745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 278/557] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:29.351361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.351863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.352347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.374201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:29.375856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:29.444572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e4f9c-e0d0-4a20-9aa3-a7fc78a477a6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.470509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 279/558] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:29.470509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.498216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:29.502109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.503027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.503527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.504143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.505168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:29.505669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.507396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.520355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:29.532931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 280/559] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:29.540700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.628220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420a00-eb81-4135-b4c7-245a92513e3a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.674362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.675006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.675284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.675550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.677121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b4bc-8c8b-4978-a065-262f5485fffa None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.721476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.722523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.723015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.723493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.734868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.736597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-614a15e3-892b-4b95-81f2-81885651093d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:29.752237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:29.753317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:29.754213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:29.754213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:29.754213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:29.761347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 281/560] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:29.761484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.762833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.763252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787ab5-6fca-4287-a3a3-1de3d1350d96 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.763725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787ab5-6fca-4287-a3a3-1de3d1350d96 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.764187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787ab5-6fca-4287-a3a3-1de3d1350d96 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.766433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 282/561] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:29.767445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787ab5-6fca-4287-a3a3-1de3d1350d96 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.804302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:29.814190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:29.875003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787ab5-6fca-4287-a3a3-1de3d1350d96 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:29.879781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 280/562] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:29.879781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:29.914559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:29.915187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.915467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.915738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.916398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:29.916706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:29.919032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0114cd9-12bb-492a-adf3-885992b8b63c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:29.932374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 283/563] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:29.934229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:29.934589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:29.934862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:29.955694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:29.956925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:29.996098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac76f32-564d-4bab-a1bb-be774ee09890 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.030614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 284/564] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:30.031496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.038012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.039188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.040209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.040654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.040937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.052430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:30.057547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:30.062742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 281/565] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:30.063699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.068190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.149061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1c2d1-3df9-404d-b77d-77fa61a85dd0 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.177756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ed16-fdae-49c9-930b-266e87faa3fe None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.185650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.186276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.186577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.186844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.199451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.200890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.214610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.215284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.215568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.215839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-cd3abb0f-0618-4ecf-80b3-3016af3432ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:30.215933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:30.216814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:30.217704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:30.217704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:30.217704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:30.217704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 285/566] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:30.218382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb3b64-64ef-4f5b-9a4d-946cb8092112 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.218382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb3b64-64ef-4f5b-9a4d-946cb8092112 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.218646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb3b64-64ef-4f5b-9a4d-946cb8092112 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.222509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 286/567] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:30.222509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb3b64-64ef-4f5b-9a4d-946cb8092112 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.230426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.232361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:30.245636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:30.246942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 282/568] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:30.247848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.303476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.322993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.336606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb3b64-64ef-4f5b-9a4d-946cb8092112 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.348966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f8c3-82ab-4de8-842b-75bb12a62116 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.369441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.370643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.370929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.371233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.371892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:30.372194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.373742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cfeeb-3f95-409f-8606-c9b21d916a13 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.386806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 287/569] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:30.386960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.387055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.387126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.387218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.387289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.387363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.387429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.387429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:30.387429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.387429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.398331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 283/570] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:30.399152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.406905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:30.408678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:30.475834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 288/571] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:30.476664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.506692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f992c-2ebe-40fa-b1be-121db49fa271 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.521040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.545091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.546176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.546714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.547167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.548007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:30.548360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.549799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.563137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.563721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 284/572] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:30.564583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.588468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790eb9e-ea71-4f06-8bce-d095e6310c2c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.625952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.626675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.626957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.627227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.637968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:30.643466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:30.644458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:30.645327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 289/573] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:30.646766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.675600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0a459-fdfc-49c9-a7c9-2bf5f2ed3b91 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.710577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.711204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.711480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.711748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.722458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.723920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:30.738718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:30.745146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:30.746054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:30.746054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:30.746054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:30.746054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 285/574] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:30.746054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.754689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2385b-3703-4607-a3c8-d9a0c5f55290 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.770116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.789489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.790109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.790385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.790688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.793473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:30.797713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.799180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:30.810658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:30.811706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 290/575] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:30.812798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:30.878652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47d894-5427-472f-a5fe-31b1bf56fe91 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.912182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.912834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.912958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c3106-3783-47bc-ac50-1d1f382d6ced None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:30.913114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.913384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/aab0aa1e574a4549a1643bf0674df5c4/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.927447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=aab0aa1e574a4549a1643bf0674df5c4, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.928879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.945835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:30.946425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:30.946738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:30.947008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:30.947668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:30.947964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:30.949853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:30.957444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 291/576] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:30.958217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.009591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 286/577] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:30 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/aab0aa1e574a4549a1643bf0674df5c4/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:31.011315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.022729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.071978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d911-ecc7-45aa-824a-95c1fc5a9707 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.104299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.119486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.120645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.120931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.121209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.121864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:31.122174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.123607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.131145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2199-bbe7-4b2b-b3d8-8b00aa1e64bd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.142850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 292/578] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:31.142850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.173491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.174184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.174490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.174763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.191234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:31.195461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:31.196397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:31.197256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 287/579] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:31.197950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.252461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22517d-b69e-4d33-b80d-33a724b8e7a5 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.273092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.289875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.290477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.290776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.291044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.291727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:31.292698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.294276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.303188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2fbbd-2cfe-4f43-90bf-0aaafeb76f45 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.306803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 293/580] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:31.307892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.340904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.341528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.341798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.342060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.344101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.353077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.355314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:31.372728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:31.373812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:31.379475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:31.379475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:31.379475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:31.379475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 288/581] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:31.379475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.416670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71f67e-d3d6-4599-bd09-390bba4fa9a1 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.458381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.459057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.459331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.459601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.468301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.469730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:31.482721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:31.483701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 294/582] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:31.484639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.497528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905481-877d-4c33-817c-a15d3550a8e9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.523432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.536503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.537124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.537480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.537757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.538416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:31.538820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.540195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.554010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 289/583] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:31.554010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.587660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f1e37-513e-403d-8c23-52ec191161b9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.604124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.628410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.629001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.629274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.629542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.630257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=476b4c55503a4c01b0ad7882e62f5461) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:31.630594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.632023 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.646510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 295/584] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/role_assignments?user.id=476b4c55503a4c01b0ad7882e62f5461&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:31.646510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.669585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22262b68-acca-49d2-947a-3efe20e26643 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.712728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.713563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.713939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.714282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.715060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:31.715436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.716987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.731557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 290/585] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:31.732583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.777074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8a3f2-56e1-455d-b5a5-1061f70b2c97 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.779027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.813655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.814273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.814589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.814935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.815679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:31.816037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.817494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.839723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 296/586] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:31.840441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:31.913667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa249ebc-b6c2-4ee4-ba64-df8f1fa55dc0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.925576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:31.955727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:31.956743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:31.956863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaf4bc-7b0e-4f88-ac23-a27cfe270619 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:31.957194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:31.957562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:31.969650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:31.971398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:31.989893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:31.991125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:31.992225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:31.992225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:31.992225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:31.993151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 291/587] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:31.994215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.005989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.007178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.007529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.007868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.018116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.020324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:32.035514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:32.036471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:32.037959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 297/588] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:32.039267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.070897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.125801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4fd5-8566-42ec-ba16-d33cc42c64f4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.163858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.164494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.164774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.165099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.174314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422b02-1562-4480-81f7-059b0548aacd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.176644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.178051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:32.192739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:32.193861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:32.195064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:32.195064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:32.195064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:32.199298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 292/589] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:32.200543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.215910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.216483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.217606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.218035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.218483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.219270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:32.219721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.221316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.234840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 298/590] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:32.236092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.310222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd23a7-65c1-422b-afc7-4a734d7ec1a6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.342007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.350932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.359088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.359088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.359088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.359088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:32.359088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.359088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.363332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c76c-e684-4450-9835-eeea212992ae None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.383258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 293/591] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:32.384423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.406173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.406999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.407377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.407752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.408494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:32.408901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.410558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.427221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 299/592] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:32.428163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.479454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.513154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d28ca7-1092-4044-a5b5-0e9746ac4938 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.549189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.549938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.550331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.550706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.558986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.560644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.561085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e56e3a-a9b6-442b-aacb-67e044ece6f3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:32.573967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:32.575189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 02:33:32.576352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:32.577638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 294/593] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:32.583031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.609840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.611055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.611488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.611908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.625427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.629081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.631807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:32.656016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:32.657236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:32.658321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:32.658321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:32.658321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:32.660272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 300/594] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:32.661277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.714561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e51f98-aa4b-4da1-b58c-a177b455a89d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.754297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.763665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.765044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.765478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.766198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.769816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119cc12-75b1-47f5-955c-5b3bd21f5c97 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.775646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.778297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:32.796145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:32.800277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:32.801171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 295/595] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:32.801969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.814622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.815492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.815975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.816626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.817233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:32.817683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.819378 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.844187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 301/596] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:32.845214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:32.900942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:32.943586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c3c4d-95b2-4f14-a130-27cb6676ed4a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.957074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2648-6c56-4fb6-88d6-d57b7289a539 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:32.983003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:32.983527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:32.983800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:32.984073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:32.984703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:32.985003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:32.986365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:32.999197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 296/597] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:33.000049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.013924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.014973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.015431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.015849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.016747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:33.017152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.018824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.037273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 302/598] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:33.038447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.055478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:33.112018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c18ef5-57f2-4ae6-9ef8-d47ad0d3a8a6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.155720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.156371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.156655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.156928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.172219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce199e-0351-4800-8ff8-b6ccc00b0dd9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.172423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.174156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.185165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:33.194536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:33.195568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:33.196506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:33.196506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:33.196506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:33.198521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 297/599] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:33.199449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.215729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.216356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.216695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.217491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.227361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.229617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:33.246259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:33.247187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:33.248074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 303/600] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:33.249005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.314257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca080a3-18c5-4739-ace6-f5a6d074aa6e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.316292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:33.351439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823a048-839e-4913-a70c-0b265d80a19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.352101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823a048-839e-4913-a70c-0b265d80a19f None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.352375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823a048-839e-4913-a70c-0b265d80a19f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.352580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69869141-3d8f-4615-bc90-1927cc7a9360 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.352684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823a048-839e-4913-a70c-0b265d80a19f None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/27f39b9d908644379d12e3e0b4fc4635/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.369434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823a048-839e-4913-a70c-0b265d80a19f None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=27f39b9d908644379d12e3e0b4fc4635, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.371484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823a048-839e-4913-a70c-0b265d80a19f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.387377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.387973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.391834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.391834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.391834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:33.391834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.391834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.402743 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 304/601] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:33.403569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.432994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:33.443967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 298/602] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:33 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/27f39b9d908644379d12e3e0b4fc4635/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:33.445121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a405fc-1fda-4b04-8ecf-77fc45815635 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.445401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a405fc-1fda-4b04-8ecf-77fc45815635 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.445668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a405fc-1fda-4b04-8ecf-77fc45815635 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 299/603] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:33.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a405fc-1fda-4b04-8ecf-77fc45815635 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.526907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7842a8-a587-47d9-bf3f-0a9f68e73caf None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.568992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.570021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.570523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.571099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.572129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:33.572631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.575230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c370fc-d88f-4225-9771-2ea66b391153 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.589630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 305/604] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:33.591399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.591891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.592440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.597455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a405fc-1fda-4b04-8ecf-77fc45815635 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.613861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:33.615583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:33.641567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.642208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.642876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.642986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.650276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.651870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:33.664579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:33.665481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 300/605] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:33.667466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.683386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:33.704172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 306/606] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:33.706432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.736120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:33.798140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e239e-e98f-485b-a9bd-816f3f2d777a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.828220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504d23c-71ba-4b60-bd6b-07fdc21d8d6b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:33.849345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.850371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.851843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.853668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/d1aaf929efbc4f818d2f0b133d449f5d/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.887788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=d1aaf929efbc4f818d2f0b133d449f5d, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.890068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.896793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:33.897641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:33.898954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:33.899434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:33.900345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:33.902617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:33.904451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:33.922592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 307/607] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:33.924296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:33.978034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 301/608] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:33 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/d1aaf929efbc4f818d2f0b133d449f5d/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:34.049192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:34.064807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:34.080628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf66a-ab1e-408e-a650-812ce9905487 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:34.132054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30d1e6-c762-4b62-a145-18e646917c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:34.132732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30d1e6-c762-4b62-a145-18e646917c57 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.133011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30d1e6-c762-4b62-a145-18e646917c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.133289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30d1e6-c762-4b62-a145-18e646917c57 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/33c2eed340e0484880b561af4084ab7f/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.151335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30d1e6-c762-4b62-a145-18e646917c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=33c2eed340e0484880b561af4084ab7f, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:34.153035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30d1e6-c762-4b62-a145-18e646917c57 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:34.165427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:34.206901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369ac8-9fb7-4ffc-a8d5-d6da74a65e34 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:34.225957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 308/609] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:33 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/33c2eed340e0484880b561af4084ab7f/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:33:34.227697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252737f0-2333-468c-996f-a320176af713 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.228245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252737f0-2333-468c-996f-a320176af713 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.228726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252737f0-2333-468c-996f-a320176af713 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.235483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 309/610] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:34.237579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.238065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.238570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.254364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:34.260645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.260645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.261157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.274385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:34.275619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:34.286765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:34.297626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:34.298656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:34.299545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 302/611] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:34.305156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:34.438438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 310/612] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:34.466918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fca07-29b3-45a7-b88b-fc4eed55afb0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:34.492215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:34.505399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:34.506393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.512196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.512196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.512196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:34.512196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:34.512196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:34.519736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 303/613] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:34.526271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:34.599067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:34.649748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0856d-9a66-4230-944d-61cd656656a8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:34.699338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:34.700028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.700309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.700586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.712524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:34.714827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:34.736452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:34.737404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:34.742277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:34.742277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:34.742277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:34.742277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 311/614] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:34.743558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:34.778642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:34.913469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32267-7f93-4c4d-a63f-e760abe0da7d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:34.980454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:34.981434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:34.981916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:34.982383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:34.983197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f2c4-848e-4841-aa85-75b9ddf9353e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:34.983485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:34.983995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:34.986836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.000405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 304/615] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:35.005436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:35.009904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:35.047790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.050158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.050887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.052487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.077684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:35.086805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:35.086965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:35.087859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:35.088926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 312/616] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:35.100360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:35.173678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da4b0-8627-4d4f-9088-01f200ac2fe1 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:35.210615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.211633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.212134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.212692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.231703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:35.234716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:35.254556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:35.255543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:35.256477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:35.265843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 305/617] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:33:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:35.266910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1290-de98-4cde-a0e7-7a63a5317d2d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:35.271271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:35.319686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.320772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.321440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.322871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.324016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:35.324652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:35.327605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.342968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 313/618] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:35.353191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:35.412941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2a0c8-9c68-43ba-b542-963c964ce89d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:35.415435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:35.460376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:35.461044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.461044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.461044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.461044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.461365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:35.461365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:35.461365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.472447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 306/619] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:33:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:35.480190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:35.556537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9fcc-8d75-4fad-9550-9d90edaa14cd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:35.622795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.623444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.623783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.624067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.644790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:35.646243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.647289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c54941-4a79-489d-aff7-03e61afb66c0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:35.671921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:35.673209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:35.674412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:35.674412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:35.674412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:35.674412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 314/620] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:35.680677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:35.686294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.687192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.687632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.688106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.731603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:35.793922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:35.795662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.870168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:35.898179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762210df-cc64-46d6-8473-d91e571c03ec None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:35.976687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:35.977298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:35.977581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:35.977857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:35.978523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:35.978832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:35.980775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:35.995755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 307/621] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:35.998760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 315/622] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:36.001116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.004025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.144008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8705713-e7cc-4091-8f9b-556f5945a3fc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.152300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:36.196284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c966ea-5f48-4724-9427-7d518bc1c11b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.224770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.225313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.225601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.225876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] PATH_INFO: `/v3/users/swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.236646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:36.237676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.238325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.238642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.238917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.239327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:36.250958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:36.252346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-bd04b546-0c18-4a19-be48-6f6169de38df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:36.255716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:36.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:36.257623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:36.261364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 316/623] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:36.263813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e89d-b391-46c5-b908-d7553779507c None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.264328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e89d-b391-46c5-b908-d7553779507c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.265063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e89d-b391-46c5-b908-d7553779507c None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.266806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 317/624] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:36.270889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:36.271832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:36.272717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:36.272717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:36.272717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:36.272717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 308/625] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:36.272717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.274644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.275460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.275956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.292908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:36.300032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:36.302348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:36.388117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fae4c2-88db-43cb-9d5b-be1bc8b8761c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.402124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 318/626] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:36.402124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.415242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:36.456660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.458128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.458699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.459125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.460194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:36.460648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:36.467591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:36.506055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 309/627] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:36.513355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.586565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189ad45-020a-494b-b7fe-5a1998a3aa36 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.627951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.628686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.628970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.629243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.629905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:36.630206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:36.631768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad9774-f2e7-411c-ad1e-95936d9f954b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:36.635252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:36.646779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 319/628] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:36.650898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394cd8-df94-4a28-ad79-fa24e7640df2 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.650898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394cd8-df94-4a28-ad79-fa24e7640df2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.650898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394cd8-df94-4a28-ad79-fa24e7640df2 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.655120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 320/629] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:36.655931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394cd8-df94-4a28-ad79-fa24e7640df2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.656369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766daad-d7cd-492a-86dd-8863017e3c64 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.700641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.701393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.701737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.702072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.715957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:36.718072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-571ae7eb-0537-439e-ac8e-8b4e2df5d887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:36.737533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:36.739305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 310/630] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a027-3681-4838-bd4e-7473fff93ccd None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a027-3681-4838-bd4e-7473fff93ccd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.741487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a027-3681-4838-bd4e-7473fff93ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.765365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5817a027-3681-4838-bd4e-7473fff93ccd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:36.766410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5817a027-3681-4838-bd4e-7473fff93ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:36.782593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394cd8-df94-4a28-ad79-fa24e7640df2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.787990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:36.816217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.817103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.817380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.817674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.825168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:36.826231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:36.837282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:36.838341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:36.843937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:36.844406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 311/631] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:36.844495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 321/632] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:36.844495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.844625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb634-1b9c-4b45-8d6f-f33c072a5031 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.844625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb634-1b9c-4b45-8d6f-f33c072a5031 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.844625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb634-1b9c-4b45-8d6f-f33c072a5031 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.844625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 312/633] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:36.844625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecb634-1b9c-4b45-8d6f-f33c072a5031 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:36.903409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:36.955722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6aaa1-3c6f-4935-8a0f-51cec31e7a04 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.963253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecb634-1b9c-4b45-8d6f-f33c072a5031 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:36.990841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:36.991462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:36.991737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:36.992006 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:36.999617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.000482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.000767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.001036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.001676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.001981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.002747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:37.003385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4463c6-f1e1-49bf-98fa-fa01c9dd999b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:37.008274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:37.009383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:37.010306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:37.012306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 322/634] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:37.013217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.019674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 313/635] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.021178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.021632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.022082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.041191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:37.042673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:37.052190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.125039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 314/636] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:37.125903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.145519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4a5d-e7ea-4dd9-957f-9f8c512f0376 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.162208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.182913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.183927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.184217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.184817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.185788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.186100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.188421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.202030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 323/637] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.206919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.233668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709c94-269d-4146-9e15-45a2c80df4c6 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.270617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.270933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.271132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.271403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.272058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.272392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.273716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.287337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 315/638] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.287337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.297150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.311577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d542e-d055-4d4b-8c29-324be8b0c36c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.346202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.346856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.347136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.347408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.353877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.355998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:37.367163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:37.368100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:37.369060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 324/639] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:37.369543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.399227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45ac8e-b133-4ca8-9669-37b4c8604092 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.413584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.433647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.434277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.434601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.434874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.444817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:37.450525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:37.451623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:37.452510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 316/640] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:37.453214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.481109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b40637-0fba-4d7a-8e01-e9e9457a0365 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.514037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.514914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.515191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.515462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.516173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=aab0aa1e574a4549a1643bf0674df5c4) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.516475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.517891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.517994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.523555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 325/641] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/role_assignments?user.id=aab0aa1e574a4549a1643bf0674df5c4&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.524262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.557032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a116-79bb-45da-824b-9acf0ac31879 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.596880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.597529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.597810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.598084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.610026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.611530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:37.628774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:37.630049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:37.631211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:37.631211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:37.631211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:37.632434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 317/642] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:37.634086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.644109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.648201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2a1f-4353-420c-a630-cb589080be4d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.690625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.691543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.691825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.692097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.692816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.693262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.694744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.708531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 326/643] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.708531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.763285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9471e9-ed4d-41da-a0d0-d2d9c00bf286 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.788337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.802136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979128-68c7-4fd5-9658-121983108048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.802840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979128-68c7-4fd5-9658-121983108048 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.803118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979128-68c7-4fd5-9658-121983108048 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.803383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979128-68c7-4fd5-9658-121983108048 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.815155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979128-68c7-4fd5-9658-121983108048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-53979128-68c7-4fd5-9658-121983108048 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:37.819910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:37.821061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:37.822268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 318/644] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:37.823241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979128-68c7-4fd5-9658-121983108048 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.834823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa42978-1f37-4e1a-9c92-dbe663d4ec04 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.873183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.873945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.874331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.874731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.875519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.875829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.877197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.888820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 327/645] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.889875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:37.914827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:37.941309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979128-68c7-4fd5-9658-121983108048 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:37.977945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:37.979034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:37.979939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:37.980268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:37.980911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:37.981212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:37.982603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:37.999611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 319/646] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:37.999611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.004533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d040f-929a-49fd-86c3-ec13925814cf None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.038931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.039492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.039769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.040038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/476b4c55503a4c01b0ad7882e62f5461/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.040380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.056716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=476b4c55503a4c01b0ad7882e62f5461, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.058253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.103387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9d729-445b-43e7-8305-77ca91b61811 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.129619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 328/647] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:37 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/476b4c55503a4c01b0ad7882e62f5461/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:38.130782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.151787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.152471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.152758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.153029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.153712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:38.154019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.155449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.170345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 320/648] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:38.170345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.245037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.292774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f4d10-6f91-49bf-a262-6a542bb76104 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.302838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.306945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ae02-7e10-4027-8b6e-e128acc16d62 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.340169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.341198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.341551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.342009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.351342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.351983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.352274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.352533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.353355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.355645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.362149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.363759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:38.376353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:38.377341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:38.378925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:38.378925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:38.378925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:38.379141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:38.380290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 02:33:38.381211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:38.381738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 329/649] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:38.381738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.381862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 321/650] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:38.385822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.494417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc580b-2020-486a-ab46-763e8dfacc2c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.515151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4e10-8b50-4e58-883f-2a7d26686081 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.536377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.537109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.537470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.537824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.549208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.550845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.554583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.555200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.555483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.555759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.556401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:38.556709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.559068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.562811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:38.568943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:38.569848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:38.572179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:38.572179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:38.572179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:38.572179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 330/651] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:38.575946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.584086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 322/652] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:38.584086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.602816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.687209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323181fe-f344-457d-b76a-15c0edd5a3d8 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.699739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dc2a6-e428-4d1d-b518-8e734e310e89 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.723700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.724370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.724620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.724906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.725635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:38.726028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.727459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.741892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.742776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.743230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.743693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.744495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:38.745661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.747194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.751975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 331/653] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:38.753206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.765619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 323/654] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:38.765619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:38.795092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.858352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:38.867462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28918c5-399a-4b13-965f-e5a3b5e060de None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.879479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a6a5-aa6a-4393-b766-e8208da88b54 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:38.911119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.912052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.912503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.912938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.921544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:38.923242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:38.923530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:38.924328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:38.924616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:38.924891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:38.937816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:38.939043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:33:38.940099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:38.946703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 332/655] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:38.947710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.003261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.004705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.048058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.056102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f210d-6932-4040-97cc-9afa56ca74aa None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.103670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.104647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.105481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.105921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.106399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.115102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.116446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.130523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 324/656] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:39.130523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:39.133958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:39.134933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:39.136103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 333/657] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:39.136712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.244099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248aa6b-74f7-4c20-afe6-3ce9ec664627 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.249656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ea96f-9efc-4941-aa66-c2ea7c9dd335 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.287447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.288205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.288490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.288766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.289494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:39.289800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.291268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.293390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.294666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.294976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.295253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.309989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.311493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.312155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 325/658] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:39.313530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:39.331636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:39.332657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:39.333541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:39.333541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:39.333541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:39.337567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 334/659] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:39.338220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.348074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.362056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.432977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d5f07-0b69-4cd0-bfec-ed38c62d2c6d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.449293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e69d-75dc-48c8-9ae3-04d2809ddb35 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.474432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.475364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.475850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.476305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.477444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:39.478230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.480900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.486988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.487675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.488077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.488469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.504202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 326/660] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:39.505296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.570585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.571916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.581501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.618211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.628704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5322-465f-4ddd-bc51-465b8bea728d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.667686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.668294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.668574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.668845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.669501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:39.670259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.671700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.690979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 327/661] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:39.690979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.725328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 335/662] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:39.725328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.825086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271a9d3-e91c-4d31-9509-bd07b26c5d06 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.840682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e59b4-31bf-45e2-a89c-5e06df081526 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:39.848026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.861012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a66a67-cf3c-4912-adc7-cb081b776f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.861634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a66a67-cf3c-4912-adc7-cb081b776f18 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.861913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a66a67-cf3c-4912-adc7-cb081b776f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.864618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a66a67-cf3c-4912-adc7-cb081b776f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.881479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:39.882118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:39.882400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:39.882726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:39.887887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:39.893073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.895331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:39.908972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:39.909906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:39.910827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 336/663] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:39.911324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:39.938258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a66a67-cf3c-4912-adc7-cb081b776f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:39.940157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a66a67-cf3c-4912-adc7-cb081b776f18 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.018726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4a5a5-a921-43ba-a561-cb335a73f593 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.049932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 328/664] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:40.054038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.054938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.055225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.055498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.055721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8d369-339c-48c8-82e7-46a19ac30cea None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.056009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8d369-339c-48c8-82e7-46a19ac30cea None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.056284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8d369-339c-48c8-82e7-46a19ac30cea None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.062341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 329/665] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:40.062341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8d369-339c-48c8-82e7-46a19ac30cea None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.071073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.072510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:40.094021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:40.095043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:40.100798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:40.100798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:40.100798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:40.100798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 337/666] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:40.100798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.121577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.127250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.174494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8d369-339c-48c8-82e7-46a19ac30cea None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.211465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ef94-aafd-4e5a-8478-78e39b867ba0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.221211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.222366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.222847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.223268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.224130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:40.224439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.225860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f649-f3cb-4d04-beb2-18e3a74b470d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.244689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 330/667] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:40.244689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.244689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.244689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.247084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.247739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.248018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.248290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.260436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.262641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.265082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:40.266614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:40.278306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:40.279509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:40.280602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:40.280602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:40.280602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:40.283780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 338/668] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:40.284596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.345924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 331/669] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:40.346809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.363570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.395779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24045a5-78cd-4cb9-9891-83a4340fdc21 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.409971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.435024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.435743 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.435946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.436755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.436878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:40.437112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.438512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.450518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 339/670] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:40.455383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.467737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e353e1-2d5c-4b47-a158-90f12d72f746 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.506924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.507534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.507813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.508088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.508808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=27f39b9d908644379d12e3e0b4fc4635) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:40.509126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.510807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821b531-0c53-49b9-a44e-bb3764f2fa54 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.517015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 332/671] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/role_assignments?user.id=27f39b9d908644379d12e3e0b4fc4635&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:40.518244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e6df-cfc3-49cf-af75-4a9afa026141 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.518563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e6df-cfc3-49cf-af75-4a9afa026141 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.518841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773e6df-cfc3-49cf-af75-4a9afa026141 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.520237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 333/672] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:40.525281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e6df-cfc3-49cf-af75-4a9afa026141 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.590331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222f3c4-9f35-45c2-8ca0-29b839dc694c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.631436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.640024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.640649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.640928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.641322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.641857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:40.642156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.644096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e36c0c-7f39-4bcb-a156-3be9ac1cbb3a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.656818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773e6df-cfc3-49cf-af75-4a9afa026141 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.661776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 340/673] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:40.661776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.661776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.661776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.670249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.681696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:40.683868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:40.701831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.702515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.702783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.703060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.710813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.712269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:40.724646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:40.725750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 334/674] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:40.727711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.769113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 341/675] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:40.769971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.852673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771e95-5578-4ba7-b6ef-ed4957b87106 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.888953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.889844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.890124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.890396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.901849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:40.903751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ef5fb-3372-48d0-b3c0-c9deecbb3bd5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:40.907253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:40.908192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 335/676] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:40.909426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:40.930481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.947420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:40.951623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:40.952657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:40.953920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:40.954344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:40.970292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:40.972099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:40.985370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:40.986657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:40.987759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:40.989797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 342/677] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:40.990983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.023638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdaa78-046b-4cdb-9782-d811e9688099 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.058595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.059217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.059501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.059775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.060465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.061026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.062202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.078585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 336/678] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.078585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.108322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aef6f3-9713-4efc-9d18-b04616d70dd9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.146373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.148338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.148338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.148338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.148338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.148670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.149849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.163014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 343/679] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.163014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.182537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:41.192156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1593a-23c0-4918-aef1-54678c9de488 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.210797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:41.231862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.232468 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.232745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.233008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.233742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.234026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.235465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.253133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 337/680] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.253133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.273266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20425-e889-4560-ad79-2804b94be741 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.307007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.307915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.308289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.308570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.318856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:41.324855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:41.325791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 344/681] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:41.331461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.356908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396a52-6772-484a-94dc-7734e833e9e7 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.392867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.393655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.393960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.394232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.395003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=d1aaf929efbc4f818d2f0b133d449f5d) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.395316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.396772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.410867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 338/682] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/role_assignments?user.id=d1aaf929efbc4f818d2f0b133d449f5d&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.411973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.437769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:41.440616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514d39d-31a3-426e-a1f5-b920bcd9defd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.442955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:41.480381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.481585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.482101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.482610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.495862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.498158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:41.515704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:41.516726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:41.517631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:41.517631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:41.517631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:41.519878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 345/683] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:41.520943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.559598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41aac1-30b0-4aac-9d06-e6d2577636a0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.608100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.608804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.609151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.609488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.610280 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=33c2eed340e0484880b561af4084ab7f) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.610698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.612175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.626566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 339/684] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/role_assignments?user.id=33c2eed340e0484880b561af4084ab7f&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.626566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.670965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e151a-c024-419b-a907-3bcff7fd1e9e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.720549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:41.723341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.723612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.723939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.724305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.724980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.725281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.726722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.737153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 346/685] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.745085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.753086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fb56d-c5f9-4a9b-aa90-e894a8b9a8e9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.773303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:41.820158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.820782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.821106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.821385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.822037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:41.822341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.823795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.845357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 340/686] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:41.850341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:41.904393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea30b06-aee7-4b75-a309-7f386fc3d367 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.959695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:41.960403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:41.960736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:41.961015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:41.977171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:41.978922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:41.983028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897900c4-ee4d-4354-b325-0d8f20d95d3d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:41.999836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:42.000879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:42.001785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:42.001785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:42.001785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:42.001785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 347/687] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:42.007417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.028505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:42.029229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:42.029576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:42.029917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:42.039488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:42.041083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:42.044486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:42.056584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:42.061757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:42.062940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 341/688] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:33:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:42.068787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.105967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:42.142030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b645610-c3d7-4deb-97f2-c8421702f563 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:42.190916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:42.191520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:42.191804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:42.192107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:42.192755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:42.193252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:42.195000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:42.221126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 348/689] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:42.226490 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.238641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfc884-761d-441e-9416-8e238cea85fe None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:42.301160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:42.301768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:42.302039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:42.302302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:42.303230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:42.303531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:42.305152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:42.339306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 342/690] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:42.345337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.403301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02252639-8b7c-41fc-9fbb-b17cd07a5e59 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:42.433537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:42.441959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:42.442934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:42.443465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:42.443959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:42.452098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:42.457906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:42.466602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:42.467666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:42.468601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:42.471677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 349/691] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:42.482557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.483169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:42.571307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f046869-af3c-45b2-be2c-a73e177f09ab None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:42.634344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:42.634975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:42.635254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:42.635959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:42.672957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74119fd-99e2-48f1-919e-f8df1cfc0558 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:42.736717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:42.737248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:42.737529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:42.737802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:42.738552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:42.738862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:42.740298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:42.758088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:42.759567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:42.774159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 350/692] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:42.780298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.819051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:42.883745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 343/693] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 02:33:42.887143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:42.890836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:42.992157 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986b26-8fce-4d1a-8a3d-a7d0354dbc42 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.048982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597e19d-fff1-46cd-becd-8627838e07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.049968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e19d-fff1-46cd-becd-8627838e07ee None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.050445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e19d-fff1-46cd-becd-8627838e07ee None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.050940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597e19d-fff1-46cd-becd-8627838e07ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.092413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f594d-0ff2-4e54-a77d-bfbd63015c89 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.129091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.129714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.129988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.130252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.142823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.144242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.151761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597e19d-fff1-46cd-becd-8627838e07ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.153963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597e19d-fff1-46cd-becd-8627838e07ee None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-fd7619ef-a228-4665-9da2-792d390e811b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:43.159771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:43.160791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:43.161673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:43.161673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:43.161673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:43.161673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 344/694] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:43.162641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2bb6-2e5d-4dfc-9456-965f162d3631 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.162919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2bb6-2e5d-4dfc-9456-965f162d3631 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.163184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad2bb6-2e5d-4dfc-9456-965f162d3631 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.166545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 345/695] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:43.167804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2bb6-2e5d-4dfc-9456-965f162d3631 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.183376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:43.217622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:43.278005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 351/696] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 02:33:43.279668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.280110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.280545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.282634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad2bb6-2e5d-4dfc-9456-965f162d3631 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.300992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:43.302580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:43.318826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.319519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.320061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.320170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.320836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:43.321205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.322672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.336162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 346/697] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:43.337093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.386684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 352/698] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:43.387929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.411020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:43.467391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39751926-9d74-4bb0-ae86-d9f20ff1961e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.534080 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.534703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.534928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.535166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.538071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:43.552424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.554664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:43.585273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:43.586343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:43.587458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:43.587458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:43.587458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:43.587458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 347/699] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:43.590699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8a85a-c208-4db6-a446-2a0053d7ecb7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.595315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.645905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.646984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.647258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.647584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.655722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.657172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:43.670257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:43.671167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:43.672360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 353/700] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:43.676976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.787601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1a5c-ec65-4d33-aae7-04f2a898d7dd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.813830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:43.824541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169c71-b741-42f4-b195-bf816fe97b0e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:43.832677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.834048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.834530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.834979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.836225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:43.837194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.839740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.858933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 348/701] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:43.860610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.870517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:43.871317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:43.871602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:43.871872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:43.872574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:43.872938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:43.875174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:43.879171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:43.893077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 354/702] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:43.894035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:43.999797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7d8f-59b8-4d70-8f6c-7af18919ef93 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.035232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254b333-74f3-4e81-8926-8c4a1718f8e3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.035437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.035952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.036228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.036493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.049859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.050711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:44.066090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:44.067315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:44.068551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:44.068551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:44.068551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:44.068551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 349/703] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:44.068551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:44.081347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.081981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.082255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.082577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.091023 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.092465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-4a42999f-4f31-4fb1-ac12-0e8110b17806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:44.105080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:44.105973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:44.107029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 355/704] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:44.107609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90b96-60bf-4d8b-80bc-7c3c0b2c1935 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.108439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90b96-60bf-4d8b-80bc-7c3c0b2c1935 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.108439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90b96-60bf-4d8b-80bc-7c3c0b2c1935 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.113672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 356/705] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:44.113672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90b96-60bf-4d8b-80bc-7c3c0b2c1935 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:44.114867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:44.174496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:44.193947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dd968-b5e0-45c5-b93f-c39fed1068fa None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.224485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90b96-60bf-4d8b-80bc-7c3c0b2c1935 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.237166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.237791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.238070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.238332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.239104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=aab0aa1e574a4549a1643bf0674df5c4) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:44.239466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.240934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.247925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 350/706] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:44 2022] GET /identity/v3/role_assignments?user.id=aab0aa1e574a4549a1643bf0674df5c4&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:44.248776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:44.286209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.287305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.287655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.288033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.288771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:44.289338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.291614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68808a8-818d-44f3-8f9c-85b85372af7a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.310866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 357/707] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:44.313650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.313932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.314205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.335865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:44.337580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:44.373834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:44.380141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6ff02-539f-40e3-bd96-7bb4d33f920f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.415681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 358/708] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:44.416525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:44.429894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.431089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.431564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.433189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.434060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:44.434635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.436086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddba65-2317-41dd-b2eb-65614892cd76 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.452772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 351/709] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:44.454149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd919083-2107-41a7-9cb1-81945ca07ef8 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.454747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd919083-2107-41a7-9cb1-81945ca07ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.455118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd919083-2107-41a7-9cb1-81945ca07ef8 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.456572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 352/710] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:44.458370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd919083-2107-41a7-9cb1-81945ca07ef8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:44.478989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:44.547897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116228fe-4868-4216-b50a-5b085b6308a6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.577389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd919083-2107-41a7-9cb1-81945ca07ef8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.597235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.598085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.598362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.598792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.599751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.601150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.622423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.623359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.623784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.626761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.626761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=476b4c55503a4c01b0ad7882e62f5461) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:44.626761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.626761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a89e9-774d-4dec-9066-58737cab127e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.633372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 353/711] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:44 2022] GET /identity/v3/role_assignments?user.id=476b4c55503a4c01b0ad7882e62f5461&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:44.634737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.635175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.635831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.657882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:44.659499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:44.679875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:44.709341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 359/712] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:33:44 2022] POST /identity/v3/users => generated 254 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:44.714861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:44.802598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 354/713] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:44.876276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac12d-2753-4b66-a325-4a071c1e44c5 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:44.888430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:44.918827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:44.919498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:44.919783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:44.920061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:44.920712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:44.922109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:44.934837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:44.936143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:44.937237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 360/714] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 14 02:33:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:44.945900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:45.055607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209d19-9c17-4afd-99ca-d4f102eb4a9d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:45.095298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:45.096110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:45.096229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:45.096633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:45.097039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:45.097833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:45.098283 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:45.100124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:45.109838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 355/715] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 14 02:33:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:45.118056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:45.139936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:45.215049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961df5d-399a-4419-980e-99fcf4c6a298 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:45.238783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d1ce7-2081-477d-a47a-905e9e4c539d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:45.253644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:45.254299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:45.254625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:45.254966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] PATH_INFO: `/v3/services/network` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:45.255582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:45.257360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:45.268228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:45.269284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:45.270127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 361/716] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:45 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:45.278935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:45.298349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:45.299381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:45.299884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:45.300361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:45.301334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:45.301646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:45.303053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:45.315324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:45.323837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 356/717] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 14 02:33:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:45.431286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bbde-9c1a-47d9-af2a-e7a87f347062 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:45.478613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:45.479784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:45.480066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:45.480326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:45.480969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] RBAC: Adding query filter params (name=network) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:45.481266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:45.482693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127bd8e-b479-4e4e-ac4a-c858d4fdf84c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:45.488224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 362/718] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:33:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:45.494133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:45.633950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:45.658848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9697cdb-c49d-4ece-bdab-9a6a4ed6dddd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:45.699569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:45.700107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:45.700387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:45.700660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:45.701294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] RBAC: Adding query filter params (type=network) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:45.701599 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:45.702985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc6886-de72-478f-bbec-89d31df3eb60 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:45.714924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 357/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:33:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:46.875932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfefdc1-10ad-4c91-a67c-174ff0b2b8c5 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:46.876481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfefdc1-10ad-4c91-a67c-174ff0b2b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:46.876563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfefdc1-10ad-4c91-a67c-174ff0b2b8c5 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:46.878206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 363/720] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:46.883854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e731-90e5-4109-897f-dadebcb0b3c6 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:46.884267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e731-90e5-4109-897f-dadebcb0b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:46.884459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e731-90e5-4109-897f-dadebcb0b3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:46.906708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5307e731-90e5-4109-897f-dadebcb0b3c6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:46.907916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5307e731-90e5-4109-897f-dadebcb0b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:47.010573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 358/721] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:47.454306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfefdc1-10ad-4c91-a67c-174ff0b2b8c5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:47.575670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:47.582443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfefdc1-10ad-4c91-a67c-174ff0b2b8c5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:47.598726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c975a3-0da6-46ff-a93b-dccd40183862 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:47.599366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c975a3-0da6-46ff-a93b-dccd40183862 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:47.599845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c975a3-0da6-46ff-a93b-dccd40183862 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:47.603183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 359/722] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:47.609038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4d59-415f-4c50-b708-a45bd041b7a9 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:47.609926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4d59-415f-4c50-b708-a45bd041b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:47.610415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed4d59-415f-4c50-b708-a45bd041b7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:47.646680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:47.647316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:47.647652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:47.647928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:47.649513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c2ed4d59-415f-4c50-b708-a45bd041b7a9 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:47.650724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c2ed4d59-415f-4c50-b708-a45bd041b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:47.668545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:47.673550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:47.674458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:47.675710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 364/723] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:47.681005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:47.751943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 360/724] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:47.753683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5893-4c8d-4fcd-b443-8234db87ae83 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:47.754067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5893-4c8d-4fcd-b443-8234db87ae83 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:47.754437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f5893-4c8d-4fcd-b443-8234db87ae83 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:47.760777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 361/725] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:47.762573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:47.762856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:47.763123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:47.769984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:47.782567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:47.783716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:47.828188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe7dd4-c710-446f-a0f1-79b1fb2b217a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:47.867488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:47.868527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:47.869063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:47.869596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:47.870730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:47.871465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:47.873143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:47.873884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 362/726] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:47.890557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 365/727] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:47.895693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.020760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b21cb-f344-4836-8ce4-1e360cf0eba3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.087400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.102070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.102739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.103021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.103294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.115336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.116868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-3ee23d8b-d5a4-4550-8dad-a2cdc6961be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:48.137888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:48.138951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:48.140152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:48.140152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:48.140152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:48.147604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 363/728] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:48.152823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.159803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7e90-108e-4a0c-ac39-822786ecc21e None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.160088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7e90-108e-4a0c-ac39-822786ecc21e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.160363 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7e90-108e-4a0c-ac39-822786ecc21e None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.161962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 364/729] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:48.171137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.171427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.171704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.182742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.194033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:48.195706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:48.278592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 365/730] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 02:33:48.278592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.286579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea66f05-a14f-48bc-999b-d69aee3f3854 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.323718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.324755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.325201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.325633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.326420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:48.326891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.328411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.341270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 366/731] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:48.342330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.392416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cf43e-a971-4bfd-9bc9-836a8880b67e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.409200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.427478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.434810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.435884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.436389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.436869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.449589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:48.454049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed452f-36dd-457b-9f01-f9e3998c0aa9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:48.455013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:48.455938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:48.456775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:48.463953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 366/732] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:48.465066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.491138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.491772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.492051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.492326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.503346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:48.508215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:48.509165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:48.510955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 367/733] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:48.515847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.580492 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f062-e03a-45e9-8a3c-0c202aecaf60 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.619526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.620343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.620635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.620744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708ca19-6d2b-423e-903b-681bb04a3a80 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.620907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.627854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.629315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:48.641561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:48.642550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:48.643522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 367/734] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:48.644120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.656222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.656826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.657104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.657376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.658037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:48.658337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.659741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e820-a16c-4f47-b269-063cb0929ed4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.661867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.668337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 368/735] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:48.669577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1fa30-465d-426b-a57f-6ebee6547c37 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.672996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1fa30-465d-426b-a57f-6ebee6547c37 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.672996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1fa30-465d-426b-a57f-6ebee6547c37 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.672996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 369/736] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:48.672996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1fa30-465d-426b-a57f-6ebee6547c37 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.681496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.745584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363418a-16d3-43b6-ac7c-4d4a7da779fc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.773888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1fa30-465d-426b-a57f-6ebee6547c37 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.778780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.779380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.779653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.779920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.780576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:48.780876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.782216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.790067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 368/737] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:48.791158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.812603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.813188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.813468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.813740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.814395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.815807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.884545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:48.890419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9914a-e54f-4621-bce8-fc349c30b837 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:48.914812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 370/738] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:33:48 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:48.915626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:48.939040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:48.940290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.941031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.941455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.942367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:48.942876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:48.944398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf00c4-ad71-4780-a8a7-a5977127cb54 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:48.973003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 369/739] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:48.973003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:48.973003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:48.973003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:48.996652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:48.998012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:49.000804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.053188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46174348-a24f-4af2-8214-b9e9d6226770 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.094836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 370/740] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 02:33:49.095179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.095824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.095924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.096105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.096500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.109517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.111007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:49.125643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:49.126639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:49.127511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:49.127511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:49.127511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:49.127511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 371/741] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:49.128384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.196127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.219627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d7606-0fff-4218-b407-844f02dc9f65 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.243504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753d23-a9ea-48c4-be50-27599cdea6d4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.254446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.261426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.262307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.262789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.263222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.275241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.278377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.284848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.285753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.286145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.286502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:49.296017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:49.296980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:49.297916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:49.297916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:49.297916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:49.299120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.300223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 371/742] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:49.301197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.302989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:49.324374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:49.325394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:49.326260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:49.326260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:49.326260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:49.332899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 372/743] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:49.332899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.420395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86c6e0-b613-4294-a486-6c2a70ef328b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.447591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8628c10-e65e-49ff-8e13-ceeae3e49d79 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.451694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.456849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.457712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.457712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.457969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.458635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:49.458936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.460375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.472660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 372/744] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:49.473485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.489650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.490255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.490571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.490845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.491487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:49.491794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.493164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.506119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 373/745] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:49.507035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.533364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.585426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d22a5-5a33-4690-8e80-d3830b3c7645 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.610969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96716f4-7cb3-4a10-8ae4-d64f3c25903e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.625112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.625825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.626099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.626366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.627140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:49.627438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.628799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.649328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 373/746] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:49.650616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.653258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.653944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.654227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.654638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.655371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.656776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.704136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.731876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 374/747] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:33:49 2022] POST /identity/v3/services => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:49.731876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.774636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc8e9-02d8-40eb-bb7c-851fa99aca81 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.836609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.837708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.838202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.839262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.849396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.851323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.856255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:49.867427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:49.868482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:49.869437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:49.873160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 374/748] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:49.873966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:49.886011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb624c-dcba-4c51-bc7e-94a88763e936 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:49.935644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:49.936277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:49.936556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:49.936829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:49.946624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:49.948855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:49.963142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:49.964204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:33:49.965137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:49.969524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 375/749] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:49.971457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.040555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e7248-b565-4b95-8429-44a018264f13 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.053243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.087100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.088046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.090836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.091414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.099662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.101475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:50.115579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:50.116615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:50.117596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:50.125515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 375/750] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:50.125515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.139128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8c16-8302-4e30-b8cb-5453ae1db8d0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.194706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.195982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.196270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.196549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.197630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:50.198497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.201190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.223535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.230658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 376/751] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 14 02:33:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:50.232245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.250081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1da4e-2ce8-4094-a29a-d368b1323623 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.287649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.288695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.289196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.289713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.290674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:50.291195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.293643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.318679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 376/752] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 14 02:33:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:50.319969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.357129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.380545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c605-8806-4c34-a1b3-fa3c8a294f20 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.436592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.437204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.437482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.437753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.438445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:50.438772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.440217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.443941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73a6aa-a9e6-4ae6-a3be-51acbac5ee19 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.460957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 377/753] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:50.460957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.488041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.488625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.488904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.489177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.538792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.580735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.582172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.592938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e15b6-ba14-42ad-b2c3-691dcc591dec None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.640911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.642251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.642919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.643049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.643569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.710866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 377/754] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:33:50.712539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.746787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.748157 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.811001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.853205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 378/755] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:33:50.859198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:50.862522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b48b-44f8-4de9-87e4-3f639e436fb9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.895816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:50.906230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:50.907622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:50.908764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:50.909398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/aab0aa1e574a4549a1643bf0674df5c4/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:50.912040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=aab0aa1e574a4549a1643bf0674df5c4, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:50.913739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:50.968681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2d331-19b1-46a1-9e3b-e0b17ec4b783 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:50.998975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 378/756] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:50 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/aab0aa1e574a4549a1643bf0674df5c4/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:51.000901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.019474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.020330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.020729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.021734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.038324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.045843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:51.073198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:51.074245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:51.075182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:51.075182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:51.075182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:51.087289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 379/757] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:51.090786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.121865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:51.222113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e26100-ab3d-4d92-aaa9-a664c7805582 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.274842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc463e4d-f958-430a-b9fb-317138418eab None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.281511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.282544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.283125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.283647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.299263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.301809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.320561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.321325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.321671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.322014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.322872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:51.323252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:51.324211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:51.325150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:51.326050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:51.326050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:51.326050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:51.326216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.329126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 379/758] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:51.335413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.344661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 380/759] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:51.346047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.387252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:51.431607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:51.464566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cea64c-aced-4acb-9dfe-95414350c209 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.470174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957a01-cfff-4a73-a217-5076240cac6f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.502710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.503320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.503601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.503872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.504624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:51.504929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.506406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d62d1-af2b-42da-a121-0b8d5aadd63d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.511182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.511885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.512230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.512568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.519632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 380/760] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:51.520877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832efc-24f0-40a6-be58-cc1aeb4ed918 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.521161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832efc-24f0-40a6-be58-cc1aeb4ed918 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.521432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832efc-24f0-40a6-be58-cc1aeb4ed918 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.521902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.522881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 381/761] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:51.523589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.527469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5832efc-24f0-40a6-be58-cc1aeb4ed918 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-481dbfb3-5679-4bc3-ba8e-f0445732fb15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:51.538021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:51.538970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:51.539851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:51.542558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 381/762] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:51.543824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.544107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.544383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.563206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:51.564503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:51.647360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:51.654499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 382/763] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:33:51.654652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5832efc-24f0-40a6-be58-cc1aeb4ed918 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.655742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.690161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.690885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.691556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.691832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.700496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.702104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:51.731278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:51.732418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:51.733439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:51.735204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 382/764] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:51.740856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.774970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:51.844764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc5f42-220d-4f4f-9048-bebeeb1da86f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.887081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc18c-a093-4623-969e-d2473699547e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:51.911530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.912533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.913015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.913505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.914402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:51.914933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.922489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.935900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:51.935900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:51.935900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:51.935900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:51.936379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:51.936379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:51.936716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:51.942381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 383/765] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:51.948632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.950224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 383/766] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:51.955847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:51.976246 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:52.090498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e98f7-3fd7-481b-b06a-0deb2e61cd7b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.097361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def8d4d-2c69-4096-9e31-30eb12840205 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.123506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:52.131427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:52.132318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.132607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.132883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.133616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=290af177fc5949098721ca1b909d9ff3) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:52.133927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:52.135476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:52.137174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:52.138184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.138789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.139263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.140443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=476b4c55503a4c01b0ad7882e62f5461) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:52.141043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:52.150512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 384/767] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/role_assignments?user.id=290af177fc5949098721ca1b909d9ff3&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:52.150512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:52.152410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a916-cfaa-4103-9288-4edbdc3b031a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:52.159645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 384/768] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:51 2022] GET /identity/v3/role_assignments?user.id=476b4c55503a4c01b0ad7882e62f5461&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:52.256922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:52.282485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8430c-da59-4837-99a2-e4b1791b0f69 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.284884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98188b-2789-4e83-978e-5d17ab5c2cc8 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.285173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98188b-2789-4e83-978e-5d17ab5c2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.285450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98188b-2789-4e83-978e-5d17ab5c2cc8 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.287322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 385/769] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:52.294008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.294351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.294620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.316377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:52.317635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:52.337151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:52.337820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.338220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.339139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.340146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:52.341398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:52.371695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:52.372898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:52.373735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 385/770] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 14 02:33:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:52.380146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:52.425710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 386/771] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:33:52.511300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0904-33ba-49fa-9fba-c560358f04c9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.552400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:52.555925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.556455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.556926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.558499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:52.559108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:52.560684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:52.566212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 386/772] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 14 02:33:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:52.575574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:52.721311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789d5a9-443d-478a-b30a-7d77afb54cd3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.739332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:52.740070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:52.759467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:52.760090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.760494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.761131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.761926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:52.762231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:52.762763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:52.764295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:52.771611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 387/773] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 14 02:33:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:52.778206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:52.931529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501f182-de84-4c9f-b41a-228de5821715 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.948960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b24e4-9b49-4358-909a-dc0084d76662 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:52.995721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:52.996248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:52.996521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:52.996787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:52.997476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] RBAC: Adding query filter params (interface=public, service_id=d5dc4f320472427da107269e228df002, region_id=RegionOne) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:52.997778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:52.999155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:53.011144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:53.011779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.012054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.012322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] PATH_INFO: `/v3/services/network` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.012897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:53.014229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:53.016941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 388/774] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:33:52 2022] GET /identity/v3/endpoints?service_id=d5dc4f320472427da107269e228df002&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:53.022763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:53.027405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:53.028405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:53.029275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:53.044796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 387/775] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:52 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:53.045698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:53.114962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:53.187203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:53.214930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194262d-5cd1-4a07-a932-c0a7d997be42 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:53.235570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11196f-de41-4365-a5a5-9eac57426c7c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:53.281936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:53.282481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.282766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.283042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.283649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:53.285036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:53.293396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 389/776] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:33:53 2022] GET /identity/v3/services => generated 772 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:33:53.297447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:53.298097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.298355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.298664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.299315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] RBAC: Adding query filter params (name=network) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:53.299621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:53.301037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:53.310651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 388/777] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:33:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:53.313232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:53.563208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f63e6-daca-46ee-8ee0-321b6b72db87 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:53.572516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:53.599071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:53.599688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.599965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.600242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.600878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:53.601183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:53.602613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:53.612465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 390/778] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:33:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:53.614163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:53.726828 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d10b1-99a2-439a-8849-ed77201a63cc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:53.773874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:53.774503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.774795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.775067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.775767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] RBAC: Adding query filter params (interface=public, service_id=86502065f2db4d3dbd4efe83a23a8b56, region_id=RegionOne) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:53.776233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:53.777836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fc3ef-1185-4365-8a86-df492b02d049 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:53.788753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 389/779] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:33:53 2022] GET /identity/v3/endpoints?service_id=86502065f2db4d3dbd4efe83a23a8b56&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:53.795317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:53.836326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722afa-7b6c-414e-b396-ff40826a964c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.837034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722afa-7b6c-414e-b396-ff40826a964c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.837554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722afa-7b6c-414e-b396-ff40826a964c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.839654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 390/780] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:53.845057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:53.845589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:53.846068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:53.856835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:53.881003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:53.889474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:53.988935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 391/781] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:33:54.008576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c891-9f34-481d-8d86-2953d233c3f2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:54.071185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:54.072201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:54.072718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:54.073231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:54.074041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:54.075660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:54.082121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 391/782] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:33:53 2022] GET /identity/v3/services => generated 772 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:54.289798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:54.398593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c97a-2a0c-4c81-9c62-d3fd13b79ea4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:54.430135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:54.436688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:54.437336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:54.437616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:54.437886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:54.449161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:54.454016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:54.456553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:54.457421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 392/783] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:54.461396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:54.531640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:54.617698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce257db-1db3-47fe-ba38-12640aca800e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:54.659318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:54.660304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:54.660800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:54.661285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:54.662182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:54.662735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:54.664365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:54.674420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 392/784] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:54.683812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:54.802355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff101cc-62fe-40b6-9648-7cd97a7dc85c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:54.836955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:54.837592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:54.837874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:54.838142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:54.849149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:54.850702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-5c835814-7b2e-4676-8ee1-0b5fa67a18c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:54.866043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:54.867094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:54.868013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:54.868013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:54.868013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:54.868013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 393/785] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:54.873935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:54.885487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c48de-4706-4c8c-9b4c-7c4c84a01ba6 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:54.886113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c48de-4706-4c8c-9b4c-7c4c84a01ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:54.886610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c48de-4706-4c8c-9b4c-7c4c84a01ba6 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:54.888150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 394/786] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:54.898490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91745-441f-4672-90fb-18cd8357227b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:54.898669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91745-441f-4672-90fb-18cd8357227b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:54.898830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91745-441f-4672-90fb-18cd8357227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:54.932027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ecb91745-441f-4672-90fb-18cd8357227b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:54.933769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ecb91745-441f-4672-90fb-18cd8357227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:54.982006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:55.028385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 395/787] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:33:55.065110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6eafc6-f5e8-4d60-bb38-e7549ba9ab56 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.065434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6eafc6-f5e8-4d60-bb38-e7549ba9ab56 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.065664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6eafc6-f5e8-4d60-bb38-e7549ba9ab56 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.067317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 396/788] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:33:55.068842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:55.072049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.072381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.072698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.073381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b11d79-08c1-412f-a7af-67b642247fc0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.109115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:55.110323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:55.152753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.153555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.153670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.153922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.154583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:55.154890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:55.156278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:55.185252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 393/789] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:55.192135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.200574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 397/790] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:33:55.332170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.351395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dec75-a5fd-4b7a-9d5e-1c547e512d74 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.419774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.420402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.420678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.420950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.438212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:55.439610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:55.467806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:55.469189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:55.470220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 394/791] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:33:55.477895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.493811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63807b24-82e2-4eb3-b64c-f6dd40011df8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.503084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:55.514607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:55.554736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.555374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.555651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.555921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.575579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:55.580411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:55.581351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:33:55.582196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:55.582855 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 398/792] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:55.589460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.632031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08727da4-db3e-4ce7-9f0e-669287aa22ec None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.669612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.670220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.670541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.670819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.671549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:55.671853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:55.673404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:55.694001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 395/793] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:55.695548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.702699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bd69-310f-44b8-902b-a95b3aeb58b3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.745802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.746874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.747161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.748195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.761340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:33:55.767230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:55.768168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:33:55.769002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:55.773245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 399/794] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:55.774120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.792806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:55.802272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:55.818034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914ec7-abe4-4bee-b6f5-a4dc43cef07f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.863639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.865254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.865735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.866455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:55.867327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:55.868001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:55.870598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:55.883096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 396/795] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:55.884344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:55.885402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d89b2-3bfc-4f63-a584-ab2f7b052a34 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:55.923764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:55.924399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:55.924751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:55.925090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.001516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.003034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.029091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.032178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641355f-f894-4379-8e50-d1c2b50fb273 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.080054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.080054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.080054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.080054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.080476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:56.081235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.082019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.097097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.107432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 397/796] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:56.114681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.131074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 400/797] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:33:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:33:56.132294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.247337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896332b-0fd2-436d-8660-245069175b3d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.252994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8cf1-a4cd-4bbe-8fb0-e478e97fb904 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.281718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.285352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.286010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.286285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.286592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.294199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.294873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.295155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.295429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.297658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.299136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.308090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.309571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:56.314968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:56.315907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:56.316809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:56.316809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:56.316809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:56.320597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 398/798] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:56.321695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e64be02f-9439-4f0b-a44c-d5a1cd575c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:56.325939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:56.327106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:56.328109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:56.328109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:56.328109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:56.328109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 401/799] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:56.328341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f402f-cd96-4230-89c4-91f964c7cb2c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.328738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f402f-cd96-4230-89c4-91f964c7cb2c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.328890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f402f-cd96-4230-89c4-91f964c7cb2c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.334139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 402/800] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:56.334139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f402f-cd96-4230-89c4-91f964c7cb2c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.383370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.431480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c201-3611-4f8c-9f4b-e03d7bfe9755 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.446400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f402f-cd96-4230-89c4-91f964c7cb2c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.465733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.466457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.466833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.467180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.478237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.480642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.482491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.483307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.483655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.483929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.484571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:56.484874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.486201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d548a-4736-4d9c-876a-052cfe953ebe None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:56.495668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:56.496703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:56.497581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:56.497581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:56.497581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:56.497581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 399/801] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:56.497581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.500772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 403/802] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:56.502433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.502883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.503345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.524247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:56.525513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:56.559589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.602362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 404/803] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:33:56.603713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.628349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f120a5-b230-4e2a-aa0f-c3e25582c350 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.632469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.681794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.684004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.684562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.685040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.685860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:56.686343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.688792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.708438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 400/804] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:56.708438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.738973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66285ff-4192-4c88-8543-fe6046360552 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.780189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.780731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.780993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.781260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.781894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:56.782194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.783590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.795249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 405/805] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:56.796166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.816779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49866-2e5c-4334-9ad1-696f2d4410bd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.827343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.855146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.855956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.856232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.856498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.863797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.865218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-b935cce8-2fca-40c4-92a3-bf2f9a7ec3ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:56.877504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:56.878528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 401/806] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca364-0559-4549-8558-581e28495280 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.880154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca364-0559-4549-8558-581e28495280 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.881018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca364-0559-4549-8558-581e28495280 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.881686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 402/807] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:33:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:33:56.882205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca364-0559-4549-8558-581e28495280 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.907602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e729f-7c6b-4146-b3b8-a245b121942a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:56.907850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:56.942456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:56.943110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:56.943385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:56.943713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:56.952255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:56.953689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:33:56.965110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:56.966054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 406/808] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:56.967033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:56.987574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca364-0559-4549-8558-581e28495280 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.020842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.021497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.022097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.022097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.028901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.030387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:57.041915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:57.048363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 403/809] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:57.049395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.058137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.073366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb3ca-d88f-4bf7-a435-29a668062eba None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.110700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.111333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.111611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.111881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.112460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.113823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-754e82ca-7e5c-49af-8276-15762b7a59ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:57.123105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:57.126584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:57.127504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 407/810] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Sep 14 02:33:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:57.128294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.128294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.128294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.133813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.144554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:33:57.148213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:33:57.149776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99435bb9-c249-495b-895c-e607d4f3e2a3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.183724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.184313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.184587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.184862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.185570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:57.185871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.187310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.204385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 404/811] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:57.205083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.213068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 408/812] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:33:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:33:57.214169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.299547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.309505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102d02-4943-40f3-ae70-f97d3fb11144 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.319963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be90bd-1182-4fe6-b35d-335442b0ab80 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.344709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.345555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.345837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.346111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.346866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:57.347172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.348606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.356116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.356721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.356998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.357266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.357945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:57.358248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.359690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.363491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.372293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 405/813] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:57.372293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.380443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 409/814] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:57.380443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.480067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dacbc-5430-4fb7-8673-579d1e6d3cc3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.490888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62431af-a373-48ce-a2d8-c46d0702439d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.514034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.514666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.515207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.515480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.516104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:57.516405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.517764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.522335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 406/815] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:57.523148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.531785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.532414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.532688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.532951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.542548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.544561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.545989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:57.560673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:57.561681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:57.562654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:57.562654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:57.562654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:33:57.562654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 410/816] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:57.562654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.585259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.623418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43654131-cefb-4d43-9951-93963af3b49a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.662925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.663549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.663829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.664102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.665249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de64bb-64fc-46a7-97d1-936c07499149 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.674513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.675952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:33:57.691143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:57.692123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:33:57.693038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:33:57.693038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:33:57.693038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:57.693038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 407/817] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:57.693395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.704266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.704872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.705154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.705427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.706142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=aab0aa1e574a4549a1643bf0674df5c4) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:57.706450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.707890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.713615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 411/818] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/role_assignments?user.id=aab0aa1e574a4549a1643bf0674df5c4&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:57.714734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.819780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d62ab-3569-4de8-acf0-e06ffcf45977 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.838535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.859612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.860268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.860551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.860827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] PATH_INFO: `/v3/services/network` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.861421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.862834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:57.874225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:57.875453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:57.876290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 408/819] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:57.877097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:57.901469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:57.958345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8884d-2414-4a85-a91e-2724afba7b42 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:57.994183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:57.995519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:57.995813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:57.996077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:57.996698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:57.996994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:57.998826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.001151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cba0c-e952-478a-b9b3-1b59fbc11b27 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.004046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 412/820] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.004503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.043669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.044274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.044554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.044828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.045468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:58.045768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.047165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.063523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 409/821] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.063523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.110897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.122898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1419-5d97-4640-9b37-644695526481 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.144273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.160954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.161725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.161837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.162100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.162752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:58.163055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.164643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.170699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045be1-c182-4cd3-bb8c-21894377f69e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.179030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 413/822] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.180123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.211538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.212388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.212568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.212790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.213442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] RBAC: Adding query filter params (name=network) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:58.213744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.215333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.224663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 410/823] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.224663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.294905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f69099-1e5a-4eab-9803-3581891b3494 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.330595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.331202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.331718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.331718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.332388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.333742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.334754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995dfe2-cac6-4433-b7ab-bb1250b2cdb7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.337837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.370390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.375989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.375989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.375989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.378767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.380196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:58.391680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:58.392636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 411/824] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:58.393573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.458879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 414/825] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:33:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:58.467572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.502984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d065-950c-4ebc-a267-a3650004a830 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.531484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.549901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.550570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.550854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.551123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.560317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.561886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:33:58.577277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:33:58.578268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 412/826] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:33:58.583798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.617644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.646758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3ab56-048f-4224-9ba0-3fb82d599893 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.714060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.714935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.715315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.715594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.716235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] RBAC: Adding query filter params (type=network) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:58.716682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.718606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.723366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3f290-a7ee-4604-9ab5-076d8e3d433a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.724746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 415/827] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.727327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.767051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.767899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.768479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.768892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.769810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:58.770255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.771925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.785432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 413/828] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.786585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.860703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.864228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4177-c792-44b7-b7df-85ac81fcaaed None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.879585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:58.903698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.904600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.904809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a101-0016-43c3-82a1-cb3c632550e7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:58.905226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.905729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.906587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:33:58.907064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.908663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:58.926629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 416/829] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:33:58.927964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:58.947196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:58.948368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:58.948861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:58.949283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:58.950133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:58.951838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:59.037691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f1d09-b5cb-4961-8a18-76fc780846f5 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:59.051165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 414/830] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:33:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:33:59.051706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:33:59.140236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68fe96-8403-4394-8f5e-cae052293bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:59.140983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68fe96-8403-4394-8f5e-cae052293bcc None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:59.141264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68fe96-8403-4394-8f5e-cae052293bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:59.141533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68fe96-8403-4394-8f5e-cae052293bcc None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/476b4c55503a4c01b0ad7882e62f5461/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:59.144786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68fe96-8403-4394-8f5e-cae052293bcc None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=476b4c55503a4c01b0ad7882e62f5461, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:59.148735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68fe96-8403-4394-8f5e-cae052293bcc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:59.230710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dd7b5-fd05-491e-9409-b0f77bbdf754 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:33:59.237476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 417/831] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:58 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/476b4c55503a4c01b0ad7882e62f5461/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:33:59.283227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e484-3c57-42f0-9160-60ed42c2247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:33:59.284284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e484-3c57-42f0-9160-60ed42c2247c None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:33:59.284763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e484-3c57-42f0-9160-60ed42c2247c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:33:59.285307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e484-3c57-42f0-9160-60ed42c2247c None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/290af177fc5949098721ca1b909d9ff3/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:33:59.290413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:33:59.304139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e484-3c57-42f0-9160-60ed42c2247c None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=290af177fc5949098721ca1b909d9ff3, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:33:59.305818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e484-3c57-42f0-9160-60ed42c2247c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:33:59.396474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 415/832] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:33:59 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/290af177fc5949098721ca1b909d9ff3/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:34:00.011982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaca7e-1708-42b2-ab7c-68dda3b7b84f None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.012501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaca7e-1708-42b2-ab7c-68dda3b7b84f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.012501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaca7e-1708-42b2-ab7c-68dda3b7b84f None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.014058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 418/833] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:00.019710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.020501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.020978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.039878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:00.041894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:00.123448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 416/834] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:00.400381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaca7e-1708-42b2-ab7c-68dda3b7b84f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:00.420249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:00.504960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaca7e-1708-42b2-ab7c-68dda3b7b84f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:00.539966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:00.540600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.540880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.541148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.542438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:00.543961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:00.553023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:00.553983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:00.554916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 419/835] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 14 02:34:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:00.560724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:00.672697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fa6d9-deb5-4ea3-894f-f49727d44ebf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:00.690240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:00.709303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:00.709909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.710180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.710450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.711136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:00.711431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:00.712847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c117fd3-48ba-40a0-8af9-39beed22fb81 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:00.718110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 417/836] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:00.723941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:00.729353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a334a-156f-4308-bbb5-89e6279eefb4 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.729666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a334a-156f-4308-bbb5-89e6279eefb4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.729907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a334a-156f-4308-bbb5-89e6279eefb4 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.731464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 418/837] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:00.736815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.737150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.737423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.762074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:00.764043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:00.817066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:00.836551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2005e7-f0bd-49ef-9c1d-7705c6ad29f2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:00.854559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 419/838] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:00.881341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:00.881946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:00.882228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:00.882526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:00.883210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:00.883515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:00.884927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:00.890255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 420/839] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:01.132430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:01.239662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40f630-812b-4fa3-b868-5ea5480abb7d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:01.250959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:01.275052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:01.275711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.276041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.282607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.282607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:01.282607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:01.287320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:01.288303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:01.289266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 420/840] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:01.297052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:01.401860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026631d-57b8-410d-bd56-1d57f33dce97 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:01.438946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:01.439995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.440477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.440951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.441812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:01.442429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:01.444170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e6d20-b850-4f34-b3dd-7b97e2f52188 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:01.454711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 421/841] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:01.459600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:01.563788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef345c2-3d6d-4ae0-8e5e-e34e957f9996 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:01.571185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb879-72d2-46af-bf26-f6461a776b89 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.571936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb879-72d2-46af-bf26-f6461a776b89 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.572449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbeb879-72d2-46af-bf26-f6461a776b89 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.576014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 422/842] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:01.581197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c4bb-25ca-4472-a776-d0f7774a4167 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.581807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c4bb-25ca-4472-a776-d0f7774a4167 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.582317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c4bb-25ca-4472-a776-d0f7774a4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.602789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:01.603404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.603681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.604042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.604545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8555c4bb-25ca-4472-a776-d0f7774a4167 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:01.604665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:01.604970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:01.606286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8555c4bb-25ca-4472-a776-d0f7774a4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:01.606411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dd13f-eab4-41f7-8e25-3995cff149b2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:01.610804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:01.614507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 421/843] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:01.687559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 423/844] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:01.701955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a72ea-b542-48ca-a2a6-37655905cae3 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.702489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a72ea-b542-48ca-a2a6-37655905cae3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.702926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a72ea-b542-48ca-a2a6-37655905cae3 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.704692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 422/845] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:01.712213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:01.712729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:01.713142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:01.733968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:01.735470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:01.814520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 424/846] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:01.995629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a72ea-b542-48ca-a2a6-37655905cae3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.037969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:02.117598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a72ea-b542-48ca-a2a6-37655905cae3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.128034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.173526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.174344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.176484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.176484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.188378 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:02.196035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:02.197015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:02.198390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:02.201704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 423/847] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:02.203695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.274969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:02.334499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e680563-6702-4ec8-9090-301684a61fe2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.375646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.376344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.376624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.376891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.388689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:02.394244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:02.395212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:34:02.396048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:02.400461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 425/848] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:02.402479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.435589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:02.441899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adfdf9-c346-4aa1-9124-5c7bc73675ee None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.514051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.515751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.516465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.517135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.518112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:02.518656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:02.520253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:02.529986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 424/849] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:02.537680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.551927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe87af-6ee4-48b0-8cdd-c8a9a209a0b0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.587541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:02.598998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.599703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.600007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.600421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.601257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:02.601570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:02.603251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:02.621314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 426/850] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:02.622723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.664152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f3f3a-e989-4d2a-b8c8-9b649e8de9ae None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.711755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.712511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.712797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.713066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.727191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:02.729545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:02.733977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb62306-a1f0-45ee-bc4a-577de56587bb None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:02.747611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:02.755142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:02.756022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:02.756022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:02.756022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:02.756022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 425/851] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:02.757405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.775723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:02.787531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.787531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.787531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.787531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.801124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:02.803204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:02.827982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:02.829188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:02.830088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:02.830088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:02.830088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:02.834588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 427/852] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:02.835507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.881146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b034f2-700d-44aa-8877-b5ba59aeed64 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:02.883639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:02.925890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:02.926930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:02.927733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:02.928159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:02.929224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:02.929678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:02.931708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:02.953678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 426/853] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:02.955330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:02.956652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0804317-65ea-4514-88e4-962398e039dd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.000220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.001106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.001533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.001951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.002770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:03.003219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.005291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.024352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 428/854] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:03.030593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.038371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.068648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8161f9-5b61-44a9-a8d4-17942857dde5 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.113557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.113774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.114126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.114523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.123775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.125595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:03.138671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:03.139682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:03.146196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 427/855] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:34:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:03.148487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.160273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f5b84-6b59-4e7f-9743-9f4763af2d77 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.162513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.201387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.202136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.202527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.202914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.211968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.214206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-5fdd0fa7-2a97-45de-9192-4cdbb41b5a82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:03.227543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:03.228696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:03.229904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 429/856] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:03.230711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18038-c038-4b3c-8f13-8da42436fc5b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.230711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18038-c038-4b3c-8f13-8da42436fc5b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.234850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde18038-c038-4b3c-8f13-8da42436fc5b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.236376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 430/857] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:03.237318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde18038-c038-4b3c-8f13-8da42436fc5b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.274701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f595-d0e9-4a0c-973b-51f40f95a353 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.310157 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.315162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.315809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.316038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.316307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.317032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:03.317334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.318787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17d0c-7980-42aa-93c7-f54be374619e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.336951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 428/858] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:03.338160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.338461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.338757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.355219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde18038-c038-4b3c-8f13-8da42436fc5b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.357076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:03.358271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:03.391120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.391732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.392011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.392281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.393006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:03.393314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.394759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.412983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 431/859] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:03.413721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.433990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 429/860] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:03.434928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.441969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.530446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47065557-8202-419b-85b7-9b62b7f25382 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.541928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2d7c9-bd31-493d-9f0c-cc12deeee4a1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.562954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.572018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.573260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.575260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.575260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.579931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.580856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.581389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.581870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.655317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.657218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.667449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.668991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.682234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.768519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 432/861] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:03.769356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.778439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 430/862] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:03.779740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.804370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.882515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1d78-a49e-4af6-8d66-ec92285139f7 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.884906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da44e9-c8d4-4167-bb3d-3642de5afbe6 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:03.904391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:03.918671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c06e75-e007-4c7e-aefb-86393d2cf474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.919281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c06e75-e007-4c7e-aefb-86393d2cf474 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.919385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:03.919556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c06e75-e007-4c7e-aefb-86393d2cf474 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.919823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c06e75-e007-4c7e-aefb-86393d2cf474 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.919923 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.920172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.920445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.920533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c06e75-e007-4c7e-aefb-86393d2cf474 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.921900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c06e75-e007-4c7e-aefb-86393d2cf474 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.930579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:03.932600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:03.947417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:03.948949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:03.954651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:03.954651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:03.954651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:03.954651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 431/863] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:03.954651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:03.995707 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 433/864] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:03 2022] POST /identity/v3/services => generated 269 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:03.997006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac15e-84bf-46d7-b880-21c4caccd5bb None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:03.997346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac15e-84bf-46d7-b880-21c4caccd5bb None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:03.997626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac15e-84bf-46d7-b880-21c4caccd5bb None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:03.998878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 434/865] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:03.999619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ac15e-84bf-46d7-b880-21c4caccd5bb None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.034133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.067830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ef14-24d0-4fcf-8457-75825bd765be None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.117057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.117704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.117979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.118250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.122999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ac15e-84bf-46d7-b880-21c4caccd5bb None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.132328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.132703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-82229138-d4d3-4ca1-bc18-51d716741f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:04.148739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:04.149779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:04.151342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:04.151342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:04.151342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:04.151342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 432/866] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:04.152306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.152306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.152306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.172937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:04.173154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.173699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.173976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.174133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:04.174238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.175274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:04.175274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.176541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.191987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 435/867] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:04.192826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.236411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.254226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 433/868] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:04 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:04.255361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.305926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fb485-1dd4-42dd-929f-b165cbf9df9a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.334605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.354982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.355943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.356814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.357259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.358081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:04.358586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.360205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.373333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 436/869] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:04.378486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.396167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdb28c-81cc-4a64-a2bf-cce5815dcef3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.444561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.445566 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.445922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.446271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.456694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.458580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:04.473047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:04.473956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:04.474926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:04.481687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 434/870] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:04.483429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.498232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.502156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0eaa-cb87-4aeb-9120-e27ca93bdc99 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.543042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.543686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.543961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.544227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.551206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.552638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:04.564512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:04.565453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 437/871] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:04.566362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.602580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e3a8a-61ca-433c-a755-811052ae0d6e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.617013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.642720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.643291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.643565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.643831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.644512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:04.644813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.646568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.664632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 435/872] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:04.665263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.676234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb990df-c537-4f82-8674-9e5d2048a418 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.711758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.712653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.713476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.714111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.714978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.716516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.769951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c385a9a-69b7-4c23-8fde-316d13d41e83 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.803261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:04.803851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:04.804126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:04.804392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:04.805060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:04.805357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:04.806796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:04.826523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 438/873] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:04 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:04.826523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.826814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 436/874] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:04.826814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:04.864594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.866074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:04.953761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42004-2b85-4410-b9f1-1b30c4c66c21 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:04.992807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab9638-3f8d-41c0-a36c-3f22b320138f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:05.003937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:05.004869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:05.005339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:05.005796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:05.006736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=290af177fc5949098721ca1b909d9ff3) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:05.007231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:05.008891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351ced4-45c4-499b-a346-4564ee59a00b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:05.016564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 437/875] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/role_assignments?user.id=290af177fc5949098721ca1b909d9ff3&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:05.034077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:05.034740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:05.035021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:05.035290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:05.036056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=476b4c55503a4c01b0ad7882e62f5461) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:05.036369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:05.037859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540436-a764-42ff-a5f5-b850566b815c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:05.046225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 439/876] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:04 2022] GET /identity/v3/role_assignments?user.id=476b4c55503a4c01b0ad7882e62f5461&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:06.253640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0bd35-9cc6-49d0-87b7-a77d0fc50fef None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:06.254254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0bd35-9cc6-49d0-87b7-a77d0fc50fef None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:06.254254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0bd35-9cc6-49d0-87b7-a77d0fc50fef None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:06.255804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 438/877] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:06.261302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:06.261712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:06.261887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:06.280963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:06.283443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:06.359324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 440/878] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:06.636469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0bd35-9cc6-49d0-87b7-a77d0fc50fef None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:06.736443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:06.745478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0bd35-9cc6-49d0-87b7-a77d0fc50fef None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:06.782070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:06.783101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:06.783590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:06.784062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:06.784856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:06.786410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:06.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:06.797606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:06.798649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:06.801765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 439/879] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 14 02:34:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:06.807463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:06.842915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:06.913448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6e7d-2e4f-452c-b290-c06fc343983b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:06.949990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:06.950630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:06.950906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:06.951305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:06.951939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:06.952239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:06.953722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586641-c886-4fb3-9c0d-28d7e68ca0e9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:06.959144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 441/880] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:06.967591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.081585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c12f5-5f4e-4ec2-935c-598481d5baa1 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:07.117994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:07.118623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.118898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.119164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.120569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:07.120868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:07.122221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:07.126552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f42b5-5a50-4982-adbe-91a6eaa251b1 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.126841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f42b5-5a50-4982-adbe-91a6eaa251b1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.127111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f42b5-5a50-4982-adbe-91a6eaa251b1 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.127571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 440/881] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:07.128511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 442/882] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:07.133296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.134209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.134742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.135333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.154846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:07.156403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:07.158666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:07.231505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 443/883] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:07.246904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650580-cb4b-4c6e-91f5-7d0e3c1951a0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:07.304795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:07.305449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.305720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.305999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.306777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] RBAC: Adding query filter params (interface=public, service_id=94d038c382cf4c9a924ef9a14da89ab5, region_id=RegionOne) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:07.307878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:07.309331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934fa25-1b50-4942-8629-01499bc1d2a2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:07.315096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 441/884] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/endpoints?service_id=94d038c382cf4c9a924ef9a14da89ab5&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:07.320874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.338857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:07.383427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed6f0f-559c-425a-89e6-6cedb18d23be None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.383756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed6f0f-559c-425a-89e6-6cedb18d23be None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.383975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed6f0f-559c-425a-89e6-6cedb18d23be None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.385625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 442/885] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:07.390898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.391178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.391448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.409996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:07.411196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:07.430197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47009d6b-c33b-4a5d-a8a8-e9cbdef1390c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:07.468153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77172f2e-f4c5-41ea-8f26-2c7992e02650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:07.468762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172f2e-f4c5-41ea-8f26-2c7992e02650 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.469041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172f2e-f4c5-41ea-8f26-2c7992e02650 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.469309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172f2e-f4c5-41ea-8f26-2c7992e02650 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.469902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77172f2e-f4c5-41ea-8f26-2c7992e02650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:07.471316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77172f2e-f4c5-41ea-8f26-2c7992e02650 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:07.482572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 444/886] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:34:07.482572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e4e23-33d4-40f8-aadc-5f6c70e39e9b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.482572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e4e23-33d4-40f8-aadc-5f6c70e39e9b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.482572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e4e23-33d4-40f8-aadc-5f6c70e39e9b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.482572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 445/887] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:07.486740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.487097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.487298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.489335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 443/888] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:07.509904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:07.511430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:07.511690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.530942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:07.598552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:07.610572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 446/889] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:07.648991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b969657-a3a3-4c4d-8145-d33b58b806d7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:07.688782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:07.689773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.690258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.690803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.691575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:07.693119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:07.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:07.703747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:07.704582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:07.707281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 444/890] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:07.712947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.779665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.822663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d866df-e0a7-429e-9a37-4743d0051f00 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:07.866570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:07.873830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:07.875273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.876069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.876934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.878394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:07.884818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:07.885244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:07.889479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86a32-5965-4fe3-a50c-d22182fbf397 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:07.891901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 447/891] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:07.892608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.933869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:07.934525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:07.934804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:07.935070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:07.948460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:07.955541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:07.956489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:07.957312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:07.957958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 445/892] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:07.958632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:07.959194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.001081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072b7c2-26d4-4d0c-97f1-9a90bdcc57c8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.044716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.045262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.045535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.046161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.046383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.047776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:08.058420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:08.059457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:08.060285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 448/893] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:08.061067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.071872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a30a0e-6ec8-4bb2-a15f-76bc693e45cb None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.119067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.120267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.120545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.120844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.121526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:08.121829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.123222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.134135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 446/894] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:08.135045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.138629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.171826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc64f-c04c-4ddc-9a8c-976916784444 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.201277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.211114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.215078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.215078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.215078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.215078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:08.215078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.215466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.228498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 449/895] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:08.228498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.261179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b77c1-0531-4ed0-b053-e428f0864ded None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.300937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.301461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.301749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.302014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.302677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:08.302977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.304325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.309901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 447/896] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:08.310685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.335562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfca538-1ae6-46f5-a90e-9b34552ee0f6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.372777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.373333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.373611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.373906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.374589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] RBAC: Adding query filter params (interface=public, service_id=bafa294ffead4a22b41ca19974e1b6b7, region_id=RegionOne) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:08.375108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.376241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.380258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.382108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 450/897] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/endpoints?service_id=bafa294ffead4a22b41ca19974e1b6b7&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:08.382767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.425737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548754-32e1-4a82-93c0-fa5df6658da4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.439193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.461040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.461716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.461999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.462275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.475097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.476583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.489083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29064d2-a293-48c9-a14c-2d4d311039fb None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:08.492507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:08.493478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:08.495510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:08.495510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:08.495510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:08.498970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 448/898] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:08.499842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.524414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.525112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.525386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.526261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.527028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:08.527332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.528683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.533598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 451/899] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:08.534210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.639321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db957ba-c46a-44f7-86ed-524269ad9a58 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.664005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.678697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.679317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.679603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.679877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.680494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.681362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe673f-9ffb-4148-9606-c42fc841b010 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.682455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.694805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 449/900] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/services => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:34:08.704684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:08.727093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.727726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.728047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.728324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.729676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:08.730103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.731583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.744669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 452/901] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:08.753431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:08.871601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c5a62-9a54-459c-a976-6e0aaf3342bf None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:08.909305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:08.909948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:08.910290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:08.910668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:08.919130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:08.920631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:08.932414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:08.933648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:08.935101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:08.935808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 450/902] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:08.941687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:09.051621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eea4b-66af-4b12-9b37-4fd7f9da5fac None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:09.087112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:09.087968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.089168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.089641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:09.090620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:09.091076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:09.093431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:09.113529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 453/903] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 14 02:34:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:09.119953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:09.169488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:09.235202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6de7-7617-46b7-86e3-4d22651e7d43 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:09.275336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:09.276845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.277321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.277734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:09.350702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:09.352834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:09.400428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:09.461552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 451/904] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:09.468175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:09.504478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:09.577592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591b594-b859-4211-8644-54c2223d02d6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:09.612914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:09.613614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.613896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.614165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:09.625698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:09.627180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:09.644539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:09.645730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:09.646856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:09.646856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:09.646856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:09.646856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 454/905] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:09.651898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:09.762580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec9985-8aac-41af-97d2-914fe4abfcad None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:09.799369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:09.799983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.800260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.800529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:09.801170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:09.801470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:09.803029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb91ae-325b-4513-8654-8206d08395ae None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:09.815631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 452/906] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:09.821239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:09.833976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183cb4-93b1-4c6c-9700-0e6cbecb2743 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.834266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183cb4-93b1-4c6c-9700-0e6cbecb2743 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.834560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8183cb4-93b1-4c6c-9700-0e6cbecb2743 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:09.837097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 453/907] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:09.842591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.842875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.843149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:09.850708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:09.864098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:09.865306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:09.936029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:09.943032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 454/908] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:09.955658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0fc5-dbf8-42f8-8707-8ecb987f5d85 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:09.991507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:09.992560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:09.993147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:09.993941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.002092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.003909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:10.016328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:10.017494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:10.018625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:10.020820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 455/909] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:10.027353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:10.132557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef63a67-52a0-4e6d-b803-f6a23bcd8759 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:10.171078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:10.171942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.172432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.172881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.173746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:10.174194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.175801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:10.177647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:10.188839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 455/910] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:10.195511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:10.255784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:10.308811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f822752-8bd4-4b76-9391-a8eeb3959fd0 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:10.348902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:10.349507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.349786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.350056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.350808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] RBAC: Adding query filter params (role.id=2a18cdcd827247d2aad96b8085735cad, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=290af177fc5949098721ca1b909d9ff3) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:10.351113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.352531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:10.359278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 456/911] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:10 2022] GET /identity/v3/role_assignments?user.id=290af177fc5949098721ca1b909d9ff3&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=2a18cdcd827247d2aad96b8085735cad => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:10.386520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91de3c-dfa1-4ff3-aefd-05a383a3a50f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:10.432880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:10.433405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.433688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.433965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.434596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.436127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:10.446372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:10.447404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:10.449488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 456/912] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Sep 14 02:34:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:10.457510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:10.476899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:10.579597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdb5b1-ea73-4d4a-8af1-a2a391f9f7d1 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:10.616908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:10.617890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.618371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.618870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.620884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:10.621404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.623008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:10.632742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 457/913] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:10.634313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:10.699931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:10.743821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb5fd0-3338-4a9e-9d00-ad31dfc6331a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:10.784620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:10.785235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.785517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.785793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.786434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:10.786765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.788142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd236cba-8b96-4b8e-b57f-84c389d569aa None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:10.794964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 457/914] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:10.801026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:10.901133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:10.930539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8c3d-5eb7-49a0-bc0e-bb2fad293cf8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:10.935948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752692cf-9c67-4766-8ef7-b8e49b5f938a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.936236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752692cf-9c67-4766-8ef7-b8e49b5f938a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.936510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752692cf-9c67-4766-8ef7-b8e49b5f938a None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.938080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 458/915] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:10.943105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97800d7-78cf-4a1d-aa2d-6e23070ecd63 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.943382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97800d7-78cf-4a1d-aa2d-6e23070ecd63 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.943649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97800d7-78cf-4a1d-aa2d-6e23070ecd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.964662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f97800d7-78cf-4a1d-aa2d-6e23070ecd63 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:10.966204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f97800d7-78cf-4a1d-aa2d-6e23070ecd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:10.973522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:10.974143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:10.974801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:10.974801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:10.975362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:10.976706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:11.037646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 459/916] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:11.039366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa6b68-5407-4c26-874d-ff9e5dc25e84 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.039656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa6b68-5407-4c26-874d-ff9e5dc25e84 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.039934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa6b68-5407-4c26-874d-ff9e5dc25e84 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.041344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 460/917] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:11.047325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.047608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.048013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.063890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 458/918] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:34:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:11.072221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:11.074574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:11.134618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:11.164314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 461/919] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:11.325445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:11.427881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42981a7-3272-4ce6-823e-a2e3552df143 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:11.452850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:11.460932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:11.468912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:11.469907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.471101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.471101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.471594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:11.473308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:11.484753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:11.486170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 02:34:11.487042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:11.489592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 459/920] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:11.498365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:11.564813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6a718-910c-48da-b0ea-cfc24a972312 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:11.608002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:11.609045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.611279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.611559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.612249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:11.613617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:11.616634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325476d7-c1aa-4b50-bc37-4d20cc4f0423 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:11.655090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:11.655705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.655981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.656247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.656872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:11.657199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:11.658574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:11.663930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 460/921] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:11.669436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:11.689410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 462/922] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:11 2022] POST /identity/v3/services => generated 241 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:11.743824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:11.792513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af21d0-f6ed-4bf3-9358-be120e43a98f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:11.836594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:11.837218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.837499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.837768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.838528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:11.838836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:11.840572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac4b20-1a15-45a4-a6fb-7131cece6bed None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:11.846700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 461/923] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Sep 14 02:34:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:11.852571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:11.897394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:11.962025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb115d8-0494-4e06-8c3d-910a708f92b4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:11.997657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2bf47-61ef-4598-a3c7-d236fb2b3335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:11.998311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bf47-61ef-4598-a3c7-d236fb2b3335 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:11.998618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bf47-61ef-4598-a3c7-d236fb2b3335 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:11.998889 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2bf47-61ef-4598-a3c7-d236fb2b3335 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:11.999548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2bf47-61ef-4598-a3c7-d236fb2b3335 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:12.000907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2bf47-61ef-4598-a3c7-d236fb2b3335 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:12.121587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 463/924] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:34:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:12.562977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8a670-072d-4f5c-b0d6-34f526e9adcf None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:12.563517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8a670-072d-4f5c-b0d6-34f526e9adcf None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:12.563517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8a670-072d-4f5c-b0d6-34f526e9adcf None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:12.564975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 462/925] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:12.570221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:12.571022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:12.571486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:12.590231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:12.591769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:12.668524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 464/926] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:12.942169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8a670-072d-4f5c-b0d6-34f526e9adcf None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.049461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8a670-072d-4f5c-b0d6-34f526e9adcf None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.070502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:13.099817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:13.100585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.100865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.101132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.111789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:13.116714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:13.117824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:13.118746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 463/927] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 14 02:34:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:13.124772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.145525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:13.226239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb886c4-7301-40fa-b916-a22cc22f5a50 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.263864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:13.264492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.264772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.265043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.266055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:13.266361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:13.267816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee63c-8170-4f4b-8dce-f8f0fbac3813 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:13.278582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 465/928] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:34:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:13.284105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.385607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e5e0e-8c2b-4d83-acb1-90efc0b45b19 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.390647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef85ce6-66a2-4bd5-a8b2-0b886aec1df4 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.390944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef85ce6-66a2-4bd5-a8b2-0b886aec1df4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.391221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef85ce6-66a2-4bd5-a8b2-0b886aec1df4 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.392944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 466/929] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:13.398015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.398567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.399066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.418154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:13.419686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:13.424931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:13.425620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.425899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.426165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.437267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:13.438997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:13.456064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:13.457047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:13.457958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:13.457958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:13.457958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:13.457958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 464/930] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:13.463211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.499160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:13.502500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 467/931] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:13.579484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eff586-f26e-4e7b-abee-01e154080289 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.624149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:13.624829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.625109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.625375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.626016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:13.626315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:13.627692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:13.641211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 465/932] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:13.646410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.671081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:13.752408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e2a6-7239-429e-a580-f22ba60e4cc4 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.787018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:13.787694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.787981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.788226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.795522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:13.796958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:13.799666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:13.814239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:13.815394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:13.816375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 468/933] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:34:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:13.820947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:13.921141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:13.922888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:13.933639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d69057-4123-45c6-809a-20fe1457891a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.975070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afad37-c9ca-4c81-b28b-dafef5d0a142 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:13.975877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:13.976757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:13.977323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:13.977789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] PATH_INFO: `/v3/services/compute` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:13.978603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:13.980695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-ae4b30b2-53a0-4e7b-921e-f6cb971941be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:13.990149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:13.991222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:13.992065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:13.995630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 466/934] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:14.001220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468b1e-c634-47f4-a996-194cda42ed39 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.001509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468b1e-c634-47f4-a996-194cda42ed39 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.001778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468b1e-c634-47f4-a996-194cda42ed39 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.003339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 467/935] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:14.003848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55468b1e-c634-47f4-a996-194cda42ed39 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.020464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.021369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.021645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.021906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.022668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:14.022972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.024464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8301fba-554c-4803-806b-87d9e377a189 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.043721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 469/936] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 14 02:34:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:14.045053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.045336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.045604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.064942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:14.066268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:14.134556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55468b1e-c634-47f4-a996-194cda42ed39 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.142580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 470/937] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:14.142580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.177240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.177852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.178131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.178689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.179335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:14.180120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.181760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.190605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 468/938] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:14.193101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.223722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:14.227083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:14.277973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ff469-1343-4e22-bf48-8798b2369f97 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.327842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.328466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.328744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.329014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.341361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.342861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.343177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee50bb-3f47-4ba9-828d-577de2f22183 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:14.360626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:14.361643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:14.362555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:14.362555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:14.362555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:14.362555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 471/939] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:14.367367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.388764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.389672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.390132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.390886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.392261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:14.392770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.394762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.406909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 469/940] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:14.411584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.486255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbae48-b6a6-4689-ab0c-6deefae6c4cc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.501688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:14.516463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:14.526450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.527093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.529092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.529092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.529092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:14.529092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.530078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7f82b-0d60-4962-9f94-4a3f8b979b3e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.536495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4e629-bb0f-405d-9fff-37a60f705dc3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.547887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 472/941] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:14.547887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa350c12-b405-404f-b35c-45bf3a4df11f None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.547887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa350c12-b405-404f-b35c-45bf3a4df11f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.547887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa350c12-b405-404f-b35c-45bf3a4df11f None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.547887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 473/942] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:14.551588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa350c12-b405-404f-b35c-45bf3a4df11f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.581428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.582067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.582341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.582643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.583234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.584625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e7034382-1e23-4720-b5ed-64a48b08d449 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:14.595352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:14.596392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:14.597215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 470/943] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:14.598003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.598003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.598245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.617458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:14.618830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:14.676147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa350c12-b405-404f-b35c-45bf3a4df11f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.693871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 471/944] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:14.694593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.720100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.721385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.722276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.723036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.733978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.735763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:14.752264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:14.758964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:14.759854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 474/945] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:14.762343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.781396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:14.806979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:14.807309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ff72-c3a9-45ec-91d4-9147a0782a32 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.852134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.852779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.853187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.853467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.854274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:14.854767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.856126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.862141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 472/946] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:14.867509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.909461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9c52b-a2b3-49e5-8e2e-3a6c18b2e245 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:14.954104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:14.955468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:14.956199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:14.956673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:14.957555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:14.958109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:14.960711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:14.976261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 475/947] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:14.977273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:14.984653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830eda1-5915-4aba-a0f8-22e5b9e94965 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.022545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.023281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.023561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.023833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.024691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:15.024998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.027381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.032351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 473/948] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:15.033037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:15.037321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:15.077612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:15.092448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5030-95f3-4e83-9390-3fd0ebb62123 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.128966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.129565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.129843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.130112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.130785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.132209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.134874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING keystone.server.flask.common [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 02:34:15.144984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc99f7-94c2-4669-b8fe-1b7ea2bbb178 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.180426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.180757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.sql.core [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 02:34:15.180757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 02:34:15.180757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [parameters: {'id': '03064f43c71d4f63a325125bf3677ae0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 02:34:15.180757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 02:34:15.181149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.181353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.181619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/290af177fc5949098721ca1b909d9ff3/roles/2a18cdcd827247d2aad96b8085735cad` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.184107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=290af177fc5949098721ca1b909d9ff3, role_id=2a18cdcd827247d2aad96b8085735cad)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.185518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03064f43c71d4f63a325125bf3677ae0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03064f43c71d4f63a325125bf3677ae0. Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application conn.query(q) Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 02:34:15.189021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result.read() Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 02:34:15.189802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application next(self.gen) Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application yield resource Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application next(self.gen) Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise self.value Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application session.commit() Sep 14 02:34:15.190833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.session.flush() Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application compat.raise_( Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 02:34:15.191717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 02:34:15.192665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application conn.query(q) Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application result.read() Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 02:34:15.193473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [parameters: {'id': '03064f43c71d4f63a325125bf3677ae0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:15.194324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:15.197012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03064f43c71d4f63a325125bf3677ae0. Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 476/949] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Sep 14 02:34:14 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:15.198866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:15.268443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 474/950] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:34:15 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/290af177fc5949098721ca1b909d9ff3/roles/2a18cdcd827247d2aad96b8085735cad => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:34:15.269458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:15.318523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77eb2a-abb9-4c09-9c64-c7c0f497fb5f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.358696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.359830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.360502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.361000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.362044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] RBAC: Adding query filter params (interface=public, service_id=6556355fe83247788fdb6485d4763c78, region_id=RegionOne) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:15.362669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.364509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:15.365680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.382373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 477/951] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:34:15 2022] GET /identity/v3/endpoints?service_id=6556355fe83247788fdb6485d4763c78&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:15.383682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:15.409415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:15.419893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3e74-f35c-4f13-89ac-5b83d6b4fc97 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.470914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.471939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.472428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.472930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.481593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.483589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:15.496714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:15.497902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:15.499123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 475/952] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:15.507418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:15.513739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d727-ee4a-4e84-9b55-e0f77b4534b0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.554431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ba147-49b3-4e28-9f06-7e062d547f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.555967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ba147-49b3-4e28-9f06-7e062d547f51 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.556459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ba147-49b3-4e28-9f06-7e062d547f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.557033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ba147-49b3-4e28-9f06-7e062d547f51 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.558318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ba147-49b3-4e28-9f06-7e062d547f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.560654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ba147-49b3-4e28-9f06-7e062d547f51 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.578828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 478/953] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:34:15 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:34:15.630442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d0b0-5515-4b3b-b48a-6f60d478c4f7 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:15.657168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:15.669744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:15.670362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:15.670668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:15.671396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:15.671739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:15.672040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:15.673577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6a59-d094-4ded-975c-4f3b47e62697 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:15.693297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 476/954] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:16.626423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16ad92-3744-4dbb-a475-ae6f3d1f1447 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:16.626962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16ad92-3744-4dbb-a475-ae6f3d1f1447 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:16.627069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16ad92-3744-4dbb-a475-ae6f3d1f1447 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:16.628615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 479/955] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:16.633952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba05189-2565-4db1-add6-d4e0cafe641f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:16.634352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba05189-2565-4db1-add6-d4e0cafe641f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:16.634552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba05189-2565-4db1-add6-d4e0cafe641f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:16.654763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6ba05189-2565-4db1-add6-d4e0cafe641f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:16.656007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6ba05189-2565-4db1-add6-d4e0cafe641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:16.723660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 477/956] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:16.997418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16ad92-3744-4dbb-a475-ae6f3d1f1447 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:17.095334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:17.108562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16ad92-3744-4dbb-a475-ae6f3d1f1447 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:17.146146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb9e2-f953-4e6a-ab28-accd4fa08726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:17.147118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb9e2-f953-4e6a-ab28-accd4fa08726 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:17.147651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb9e2-f953-4e6a-ab28-accd4fa08726 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:17.148140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb9e2-f953-4e6a-ab28-accd4fa08726 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:17.148999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb9e2-f953-4e6a-ab28-accd4fa08726 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:17.150681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb9e2-f953-4e6a-ab28-accd4fa08726 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:17.213046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 480/957] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:16 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:17.519491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6872b3-6550-416a-9a8c-40922f7be650 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:17.519885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6872b3-6550-416a-9a8c-40922f7be650 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:17.520076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6872b3-6550-416a-9a8c-40922f7be650 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:17.521663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 478/958] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:17.527421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:17.527706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:17.527977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:17.547343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:17.548841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:17.630580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 481/959] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:17.890959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163491-c3cd-4025-8ac4-72b55c56d90c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:17.891451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163491-c3cd-4025-8ac4-72b55c56d90c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:17.891451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163491-c3cd-4025-8ac4-72b55c56d90c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:17.893076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 479/960] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:17.898634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:17.899184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ad25-d1eb-4633-bbef-902d199b4d8d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:17.899473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ad25-d1eb-4633-bbef-902d199b4d8d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:17.899751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055ad25-d1eb-4633-bbef-902d199b4d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:17.927628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6055ad25-d1eb-4633-bbef-902d199b4d8d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:17.929493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6055ad25-d1eb-4633-bbef-902d199b4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:17.971497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.015004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbff0f-cec2-4307-bc60-957497bf5600 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.021493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 480/961] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:18.023047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382682f9-5c70-4ed6-9978-07e38b71a55d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.023513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382682f9-5c70-4ed6-9978-07e38b71a55d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.024401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382682f9-5c70-4ed6-9978-07e38b71a55d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.026980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 481/962] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:18.036051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.036821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.037274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.057624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.058398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.058769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.059149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.060303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:18.061896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:18.070294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:18.075794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:18.076858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:18.077704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:18.082085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 482/963] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 14 02:34:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:18.083303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.130537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.164042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 482/964] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:18.211397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363283c-6dd2-4048-ae7d-84d22835c634 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.235129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.248361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.255879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.255879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.255879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.255879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:18.255879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.255879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.266161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 483/965] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:18.267719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.294095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.386941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c026144-0a28-4ed3-afb4-23ee818e378b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.408162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6100-e063-4e0d-ab2e-5670e38194a4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.424101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.424762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.425042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.425315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.436832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.438268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.452056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.452955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.453410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.453855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:18.453980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:18.454896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:18.455785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:18.455785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:18.455785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:18.457210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.458797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 483/966] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:18.459217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.461237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:18.470869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:18.471955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:18.472807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:18.475968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 484/967] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:18.483995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.499816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.536324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.574754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1489-1b40-4a55-b421-7ffeae482e66 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.591488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d935-13d4-458d-bcfe-368e9d62a45e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.609554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.610164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.610437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.610733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.611368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:18.611666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.613007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.626727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.627329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.627606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.627872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.628495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:18.628793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.630129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 484/968] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:18.630233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.630830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.635592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 485/969] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:18.636522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.727643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.737772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66c644-88ce-48da-8bc4-167ceea80d04 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.743051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f71f-4447-43ad-a53e-1b7c61ff1027 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.750841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:18.772202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.772824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.773098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.773364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.780943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.781098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.781552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.781827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.785345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.785463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.785543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.785543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.786737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING keystone.server.flask.common [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:18.794286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:18.795443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 486/970] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:18.796427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.828849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.sql.core [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 02:34:18.828849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 02:34:18.828849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [parameters: {'user_id': '2cfd68c3ff794cd2930ec02ef79f59b9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 02:34:18.828849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application conn.query(q) Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application result.read() Sep 14 02:34:18.846221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 02:34:18.847372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application next(self.gen) Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application yield resource Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application next(self.gen) Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise self.value Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application session.commit() Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 02:34:18.853683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self.session.flush() Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application compat.raise_( Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 02:34:18.854901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 02:34:18.855965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application conn.query(q) Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application result.read() Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 02:34:18.857715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [parameters: {'user_id': '2cfd68c3ff794cd2930ec02ef79f59b9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:18.858851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 02:34:18.859837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 485/971] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Sep 14 02:34:18 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:18.861939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.919910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea987-4bfd-443c-b157-9ef94a2708c4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:18.953506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:18.954104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:18.954430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:18.954744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:18.955369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:18.955665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:18.957198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:18.967352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 487/972] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:18.967352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:18.973175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da292a1-2d4e-47c4-a567-21fbe3bb8cba None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.001490 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:19.010040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.014291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.014291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.014291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.014291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:19.014291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.014291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.035006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 486/973] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:19.040429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.049417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:19.069958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25124f0a-494c-4f3d-bd19-027d17769fd2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.115223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.116015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.116397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.116770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.124615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.126176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:19.137759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:19.138937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 02:34:19.140130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:19.141294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 488/974] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:34:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:19.142071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.160070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f832da-6bf6-497c-a21b-c070bb71735b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.199184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.199863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.200072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.200338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.200999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.202391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.242089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:19.248727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b31121-030a-42b2-a5a3-2d6c67c6fa05 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.290591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 487/975] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:34:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:19.290591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.299150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.299951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.300234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.300504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.367637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:19.405308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.407039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.414505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01702-9ff6-4841-b8ce-ce4f4fd94e32 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.457054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.458139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.458770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.459240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.460220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:19.460714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.462620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49e14-a72e-4cc5-833c-e3cfb930fa8b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.504144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 488/976] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Sep 14 02:34:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:19.505541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3acf1e-7d1f-4c84-aab8-509894a2aed9 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.505831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3acf1e-7d1f-4c84-aab8-509894a2aed9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.506106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3acf1e-7d1f-4c84-aab8-509894a2aed9 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.507571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 489/977] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:19.514224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.514525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.514804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.521466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:19.534351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 489/978] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:19.537301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:19.538662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:19.540418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.637593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 490/979] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:19.666870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d388-f9b7-4578-bf7b-2f4c442fee64 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.706144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.706808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.707084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.707353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.718609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.720069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:19.736644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:19.737636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:19.738553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:19.738553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:19.738553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:19.738553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 490/980] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:19.745493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.800619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:19.853940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488a879-9ac1-4cac-8f63-0dd50ac98bf1 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:19.890054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:19.890884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:19.891166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:19.891440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:19.892109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:19.892418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:19.893785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:19.910367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 491/981] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:19.911787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.911926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:19.961158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:20.023578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c6f2e-0eb8-4827-a66a-ccfc8c77a0b2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.032371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14652e0b-002d-4be4-86f9-09217ebad0ef None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.043863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:20.063162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.063800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.064238 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.064519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.069357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.069983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.070258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.070550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.071136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.072203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.072604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.074198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:20.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:20.083443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:20.084471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:20.088538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 492/982] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:20.089501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:20.097328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:20.098230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:20.104632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 491/983] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:20.105131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:20.195765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df00f9-c080-4ebf-85e5-de9aa97de2f8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.215281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8805c84-189c-45d3-8b51-8a27c1eb375c None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.218728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:20.232498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.233223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.233419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.233679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.234304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:20.234636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.236015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.241223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 493/984] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:20.246759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:20.249931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.250573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.250865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.251375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.252231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:20.253037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.254500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.268931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 492/985] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:20.274540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:20.295830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:20.366929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1634709-d22a-47c6-87fd-036326e9f167 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.391946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8710a-52af-4075-9724-4e243d01cc82 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.403731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.404341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.404621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.404897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.405513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:20.405816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.407204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.417412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 494/986] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:20.418432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:20.432222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.432817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.433090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.433354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.434065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] RBAC: Adding query filter params (role.id=2a18cdcd827247d2aad96b8085735cad, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=290af177fc5949098721ca1b909d9ff3) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:20.434367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.435815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.441629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 493/987] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:20 2022] GET /identity/v3/role_assignments?user.id=290af177fc5949098721ca1b909d9ff3&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=2a18cdcd827247d2aad96b8085735cad => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:20.530550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8122e-9a58-4a07-8b1c-db33bd6c9d52 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.532170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:20.568605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.569248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.569530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.569802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.570554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] RBAC: Adding query filter params (interface=public, service_id=62676f6edcc24957873b83e52f9355ac, region_id=RegionOne) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:20.570893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.572287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490ad82-5cb1-4d31-bae2-38d69c7439a4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.583556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 495/988] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:34:20 2022] GET /identity/v3/endpoints?service_id=62676f6edcc24957873b83e52f9355ac&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:20.585262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:20.618311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:20.699974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7acf78-0db3-4a10-98df-5f703c598f93 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:20.735599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e000f1-4e44-41b9-b1ca-7f5caa5239c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:20.736205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e000f1-4e44-41b9-b1ca-7f5caa5239c2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:20.736548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e000f1-4e44-41b9-b1ca-7f5caa5239c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:20.736818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e000f1-4e44-41b9-b1ca-7f5caa5239c2 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:20.737429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e000f1-4e44-41b9-b1ca-7f5caa5239c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:20.738813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e000f1-4e44-41b9-b1ca-7f5caa5239c2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:20.747745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 494/989] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:34:20 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:34:21.594901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b289-1294-4382-9950-dcb687701840 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:21.595426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b289-1294-4382-9950-dcb687701840 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:21.595504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b289-1294-4382-9950-dcb687701840 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:21.596984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 496/990] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:21.602250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:21.602557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:21.602833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:21.622000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:21.623207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:21.693276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 495/991] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:21.959237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b289-1294-4382-9950-dcb687701840 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:22.063785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b289-1294-4382-9950-dcb687701840 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:22.104661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:22.105059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.105336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.105603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.106177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:22.107565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:22.116239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:22.117215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:22.118148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:22.122619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 497/992] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:22.123407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:22.146679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:22.222259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0a4e-e049-4b40-b6a2-19c4b236f1f4 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:22.264974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:22.265877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.266158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.266426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.267077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:22.267374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:22.268735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:22.279894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 496/993] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:22.282275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:22.315113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:22.383870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34839-c66a-4fe6-9af7-c0d6efe0bf35 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:22.418044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:22.418682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.418962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.419236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.419856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:22.420158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:22.421506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:22.426608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 498/994] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:22.432511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:22.526179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:22.541127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e1677-67af-48e2-9982-fba75c88a084 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:22.578977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:22.579590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.579864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.580133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.580853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] RBAC: Adding query filter params (interface=admin, service_id=6556355fe83247788fdb6485d4763c78, region_id=RegionOne) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:22.581159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:22.582592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b1f44-8487-4c70-b60e-b22e0d845ef4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:22.593216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 497/995] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Sep 14 02:34:22 2022] GET /identity/v3/endpoints?service_id=6556355fe83247788fdb6485d4763c78&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:22.594580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:22.689682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:22.697298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d31ee-2afd-496e-9af6-c5fbfca1587a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:22.701480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c661-e76e-4d38-8fdc-7662cf261598 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.704506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c661-e76e-4d38-8fdc-7662cf261598 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.704506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c661-e76e-4d38-8fdc-7662cf261598 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.704506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 498/996] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:22.708402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a427986-037f-43b0-b0a6-b15850131b73 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.708749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a427986-037f-43b0-b0a6-b15850131b73 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.709029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a427986-037f-43b0-b0a6-b15850131b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.727894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5a427986-037f-43b0-b0a6-b15850131b73 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:22.729114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5a427986-037f-43b0-b0a6-b15850131b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:22.737287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385020-1f19-4b70-a0ef-9e6803113f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:22.737899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385020-1f19-4b70-a0ef-9e6803113f71 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:22.738176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385020-1f19-4b70-a0ef-9e6803113f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:22.738447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385020-1f19-4b70-a0ef-9e6803113f71 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:22.739073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385020-1f19-4b70-a0ef-9e6803113f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:22.740413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385020-1f19-4b70-a0ef-9e6803113f71 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:22.747590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 499/997] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:34:22 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:34:22.810599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 499/998] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:23.002054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364504-11fd-42a7-9e6f-a0c1e6055f3c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.002413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364504-11fd-42a7-9e6f-a0c1e6055f3c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.002648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364504-11fd-42a7-9e6f-a0c1e6055f3c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.004121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 500/999] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:23.009213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.009510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.010313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.030133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:23.031328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:23.083335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364504-11fd-42a7-9e6f-a0c1e6055f3c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:23.105756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 500/1000] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:23.188948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364504-11fd-42a7-9e6f-a0c1e6055f3c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:23.232465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:23.233101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.233379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.233647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] PATH_INFO: `/v3/services/image` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.234225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:23.235609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:23.245028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:23.246190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:23.249289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:23.250721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 501/1001] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 14 02:34:23 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:23.251916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:23.265176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:23.354911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7325-eedf-45bc-87a6-002f93d2b26d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:23.378166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:23.390271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:23.391476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.391757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.392301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.392986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] RBAC: Adding query filter params (name=image) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:23.393291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:23.395214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:23.406305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 501/1002] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:23.406525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:23.407514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:23.485230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27852bce-6689-443a-9a79-d90bd2020ef9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:23.489516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:23.527585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d1e3-6c0e-4d0e-97d2-fa1a61228adc None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:23.534295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:23.534978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.535262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.535532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.536120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:23.537490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:23.547743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:23.548751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:23.549600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 502/1003] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:23.555122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:23.569355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:23.569963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.570239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.570530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.571158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] RBAC: Adding query filter params (type=image) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:23.571460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:23.573355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:23.586501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 502/1004] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:23.661604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:23.678648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7472e-fd35-43f9-b509-24ba3608d956 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:23.717192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:23.718605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.719075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.719562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.720384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:23.720886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:23.722456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:23.733405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 503/1005] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:23.735444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:23.842628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20e3c-25dc-4324-8132-131d7c741c5a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:23.879410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:23.880301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:23.880766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:23.881244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:23.882050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:23.882562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:23.884106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3155e-cfc9-4365-85cb-209af48b0f4f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:23.894231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 503/1006] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Sep 14 02:34:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:23.895956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:24.002252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237b655-05af-40fb-b988-92803f0cd9d2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:24.036469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c314c0e-2c63-42e5-8981-114240eaf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:24.037073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c314c0e-2c63-42e5-8981-114240eaf641 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:24.037348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c314c0e-2c63-42e5-8981-114240eaf641 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:24.037616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c314c0e-2c63-42e5-8981-114240eaf641 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:24.038267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c314c0e-2c63-42e5-8981-114240eaf641 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:24.039663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c314c0e-2c63-42e5-8981-114240eaf641 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:24.155663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 504/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:34:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:34:24.965277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c6d86-ddae-4f60-b849-a695bd9d22ac None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:24.965826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c6d86-ddae-4f60-b849-a695bd9d22ac None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:24.965826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c6d86-ddae-4f60-b849-a695bd9d22ac None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:24.967482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 504/1008] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:24.972603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:24.972996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:24.973184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:24.986572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:24.992215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:24.993404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:25.068636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 505/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:24 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:25.339897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c6d86-ddae-4f60-b849-a695bd9d22ac None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:25.343012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:25.445136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c6d86-ddae-4f60-b849-a695bd9d22ac None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:25.480175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:25.480809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:25.481088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:25.481355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:25.481934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:25.483337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:25.492163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:25.493177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 02:34:25.494041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:25.498537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 505/1010] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Sep 14 02:34:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:25.500137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:25.599596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98000d-d3b6-4494-8ea4-82c6d32e5a12 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:25.631891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:25.638151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:25.638821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:25.644506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:25.644506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:25.644506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:25.644506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:25.644506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d22f0-2651-4728-8a07-082ae76dbd04 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:25.653163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 506/1011] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:25.654751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:25.719552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:25.748567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebb29-898b-4daa-98c4-8a698af7f68d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:25.748849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebb29-898b-4daa-98c4-8a698af7f68d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:25.749123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebb29-898b-4daa-98c4-8a698af7f68d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:25.750592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 507/1012] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:25.755433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:25.755716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:25.755993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:25.762553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85ef1a-d25d-47dc-b73a-fb687166c43e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:25.774568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:25.776394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:25.805979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:25.806630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:25.806949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:25.807220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:25.807842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:25.808143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:25.809493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:25.818502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 506/1013] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Sep 14 02:34:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:25.820767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:25.850720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 508/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:25 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:25.927068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e28b6-38f2-40fc-8ae4-afeec93741ac None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:25.955343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:25.961668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eb859-5a2c-482d-89bf-e6e763e6bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:25.962270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eb859-5a2c-482d-89bf-e6e763e6bf1e None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:25.962607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eb859-5a2c-482d-89bf-e6e763e6bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:25.963036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eb859-5a2c-482d-89bf-e6e763e6bf1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:25.963908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98eb859-5a2c-482d-89bf-e6e763e6bf1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:25.965270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98eb859-5a2c-482d-89bf-e6e763e6bf1e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:26.050101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 507/1015] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:34:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:34:26.125398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:26.230202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae7d32-7c73-4994-9a1a-f10aca1eb855 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:26.259906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:26.274342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeecb4-9d0d-44cb-9b5b-fed8600042e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:26.274981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeecb4-9d0d-44cb-9b5b-fed8600042e6 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:26.275254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeecb4-9d0d-44cb-9b5b-fed8600042e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:26.275704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeecb4-9d0d-44cb-9b5b-fed8600042e6 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:26.276557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeecb4-9d0d-44cb-9b5b-fed8600042e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:26.277978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeecb4-9d0d-44cb-9b5b-fed8600042e6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:26.371497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 509/1016] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:26 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:26.455937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d6d39-9566-4511-b110-1d0b6956abb3 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:26.456298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d6d39-9566-4511-b110-1d0b6956abb3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:26.456497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d6d39-9566-4511-b110-1d0b6956abb3 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:26.458066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 508/1017] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:26.464494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:26.464788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:26.465057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:26.485113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:26.486342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:26.567448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 510/1018] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:26.852110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d6d39-9566-4511-b110-1d0b6956abb3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:26.965290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d6d39-9566-4511-b110-1d0b6956abb3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:27.001445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:27.002100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:27.002378 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:27.002682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:27.014983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:27.020167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:27.021080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:27.021925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:27.026247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 509/1019] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 14 02:34:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:27.028402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:27.137579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6538-a686-4505-b906-f5aab8082b1e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:27.147577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:27.172157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:27.172767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:27.173043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:27.173310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:27.173964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:27.174265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:27.175734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:27.186367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 511/1020] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:34:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:27.191876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:27.247241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:27.302235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f564-d4ae-4090-b322-d835722ebe26 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:27.337505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:27.339180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:27.339465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:27.339737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:27.350298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:27.351867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:27.367391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:27.368356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:27.369340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:27.369340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:27.369340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:27.370069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 510/1021] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:27.375120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:27.483113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01361b87-f9a4-46c1-97e8-d9ee3e05ef4b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:27.519271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:27.519879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:27.520160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:27.520427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:27.521057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:27.521361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:27.522738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:27.541833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 512/1022] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:27.541987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:27.645235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2bedc-b206-4f05-8f4e-e513f5a63373 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:27.646907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:27.679585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:27.680207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:27.680480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:27.680745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:27.689443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:27.690909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:27.701933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:27.703135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:27.704131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 511/1023] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:34:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:27.710587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:27.741397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:27.812478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c86ec-daff-457f-8743-747fe1fee3df None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:27.847038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:27.847643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:27.847923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:27.848191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:27.848908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:27.849209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:27.850653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:27.874460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 513/1024] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:34:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:27.876146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:27.977819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9e578-1365-4dac-866e-066f39e24d12 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.011713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6963b-6bb3-4c0e-9a75-69cb51fff5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:28.012248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6963b-6bb3-4c0e-9a75-69cb51fff5c4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.012526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6963b-6bb3-4c0e-9a75-69cb51fff5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.012797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6963b-6bb3-4c0e-9a75-69cb51fff5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.043612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:28.081035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6963b-6bb3-4c0e-9a75-69cb51fff5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:28.082516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6963b-6bb3-4c0e-9a75-69cb51fff5c4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:28.185389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 512/1025] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 02:34:28.191616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.279451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:28.295276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ef76-c554-4599-8d15-f82260d0fcf8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.296083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d2fb-6194-4ad5-8760-325182925c5a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.296501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d2fb-6194-4ad5-8760-325182925c5a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.300880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2d2fb-6194-4ad5-8760-325182925c5a None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.300880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 513/1026] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:28.303128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.303408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.303675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.321953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:28.323238 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:28.336007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:28.336643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.336932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.337206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.348225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:28.349661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:28.365282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:28.366523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:28.367583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:28.367583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:28.367583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:28.367583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 514/1027] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:28.372519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.390770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:28.402501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 514/1028] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:28.482241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2020e-602e-422a-9309-28202034fb5a None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.516271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:28.516909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.517189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.517460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.518123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:28.518442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:28.519876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e0575-3759-4b11-83b6-5da116d624b3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:28.530985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:28.539916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 515/1029] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:28.542434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.638206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786a70-a0d8-4e7d-b415-e9da4de38d3a None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.638585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786a70-a0d8-4e7d-b415-e9da4de38d3a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.638773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786a70-a0d8-4e7d-b415-e9da4de38d3a None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.640115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 516/1030] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:28.645266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.645547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.645810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.647104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ac8a-2ecb-4c05-8090-2355a2d7911c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.666721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:28.668284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:28.683629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:28.684261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.684538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.684809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.691574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:28.693173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:28.704828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:28.705779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 515/1031] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:28.707080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.739365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 517/1032] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:28.742666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.764129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:28.812475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdac09-d5b3-4d07-8232-ad80ec36bb31 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.846019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:28.846342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205ddae-338b-4abc-9f77-5427f46a3b5a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.846661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.846939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.847218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.848309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:28.849740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:28.851495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 516/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:28.857418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.879591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:28.890909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:28.891526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:28.894812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:28.894812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:28.894812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:28.894812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:28.895307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:28.913712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 518/1034] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:28.915392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:28.971492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da116-550f-4cf4-8191-fb25179f9b65 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:28.994156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:29.012801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.013415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.013698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.013973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.014654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.016363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.027945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fcb38-d31e-4de5-850a-4ebba65ce181 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:29.060480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.061075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.061368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.061618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.062323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] RBAC: Adding query filter params (role.id=2a18cdcd827247d2aad96b8085735cad, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=aab0aa1e574a4549a1643bf0674df5c4) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:29.062704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.064058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.069289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 519/1035] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:28 2022] GET /identity/v3/role_assignments?user.id=aab0aa1e574a4549a1643bf0674df5c4&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=2a18cdcd827247d2aad96b8085735cad => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:29.070049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:29.125065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 517/1036] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:28 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:34:29.144125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:29.199042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f52f0d-e3dd-4086-8e53-6f2508154428 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:29.238682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.239355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.239634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.239903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] PATH_INFO: `/v3/services/image` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.240723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.242156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:29.252658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:29.253753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:29.255052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:29.258971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 520/1037] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 14 02:34:29 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:29.261229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:29.381223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d8c6f-c38e-4605-969f-54783b199d77 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:29.417835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.418446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.418755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.419028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.419663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] RBAC: Adding query filter params (name=image) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:29.419965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.421335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.426607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 518/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:29.432645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:29.536769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d771ce3-5a3a-439b-83ec-abdc4c77c93b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:29.554208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:29.573397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.582710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.582710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.582710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.582710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:29.582710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.582710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.586570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 521/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:29.588755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:29.626745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:29.695090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd0d9d-f3c5-42ca-8b19-c381bb960e1e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:29.729508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.730192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.730487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.730789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.731489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] RBAC: Adding query filter params (interface=public, service_id=44cfdde769ba4b79978ca472316c4a74, region_id=RegionOne) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:29.731799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.733164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d044cb-6384-444e-a2b5-3fbefe31501a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.743080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 519/1040] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:34:29 2022] GET /identity/v3/endpoints?service_id=44cfdde769ba4b79978ca472316c4a74&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:29.745174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:29.848497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8e2d-4d47-44ee-8a0d-18d678971ae3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:29.881464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141495e-6cd7-4103-ba71-5afe8747e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:29.882078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141495e-6cd7-4103-ba71-5afe8747e037 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:29.882356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141495e-6cd7-4103-ba71-5afe8747e037 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:29.882649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141495e-6cd7-4103-ba71-5afe8747e037 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:29.883249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141495e-6cd7-4103-ba71-5afe8747e037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:29.884597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141495e-6cd7-4103-ba71-5afe8747e037 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:29.892221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 522/1041] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:34:29 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:34:31.266976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413185d8-d763-47b3-a915-726fb7742c9c None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.267499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413185d8-d763-47b3-a915-726fb7742c9c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.267499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413185d8-d763-47b3-a915-726fb7742c9c None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.268916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 520/1042] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:31.274589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.275021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.275213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.293960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:31.295182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:31.337867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:31.361758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf27d4-63af-45ef-8874-97757d06afe7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.362027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf27d4-63af-45ef-8874-97757d06afe7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.362234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf27d4-63af-45ef-8874-97757d06afe7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.363762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 521/1043] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:31.366589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 523/1044] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:31.371226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.371510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.371784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.389562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:31.391033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:31.458208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 522/1045] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:31.628663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:31.727456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb54a65-2767-4c1d-899d-4399093e2d6e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:31.731935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:31.762424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:31.764678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:31.765323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.765871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.766139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.777695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:31.783496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:31.784620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:31.787461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 524/1046] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 14 02:34:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:31.792467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:31.836432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:31.842598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e22aa-55bf-4d1d-a114-045829482cdf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:31.879608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:31.880277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.880561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.880832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.881934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:31.883417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:31.885348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 523/1047] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:31.891067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:31.911963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3c4e0-835f-42f4-b63b-b4e5370476cb None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:31.954814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:31.955556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:31.955866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:31.956367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:31.956918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:31.957223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:31.958869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:31.974608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 525/1048] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:34:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:31.976495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:31.996349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.000000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef257ffa-4a25-4c13-a29b-c75f1b9297b4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.036702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.037312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.037594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.037870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.038979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.040687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.082678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.086553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2215b-5038-4958-804e-17bef62dd4cc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.118886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.120268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.120547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.120815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.130905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.132276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-fea028c7-f520-46a0-ab3c-79bdba9aed6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:32.145930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:32.152820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:32.154013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:32.154013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:32.154013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:32.154013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 526/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:32.154013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b86ef7-499a-41c9-bb90-a28d424462a3 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.154013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b86ef7-499a-41c9-bb90-a28d424462a3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.154446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 524/1050] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:34:31 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:34:32.154580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b86ef7-499a-41c9-bb90-a28d424462a3 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.154580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 527/1051] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:32.155720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.160447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03453674-9923-448c-97db-184f896ba98c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.161115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03453674-9923-448c-97db-184f896ba98c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.161642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03453674-9923-448c-97db-184f896ba98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.183482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-03453674-9923-448c-97db-184f896ba98c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:32.187106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-03453674-9923-448c-97db-184f896ba98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:32.266498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 528/1052] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:32.278343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7090c6-9368-4dae-a327-d2c7cf731c17 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.316641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.317255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.317536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.317804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.318445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:32.318776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.320153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.333823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 525/1053] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:32.339963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03453674-9923-448c-97db-184f896ba98c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.427735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.446968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03453674-9923-448c-97db-184f896ba98c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.483126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.483767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.484048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.484319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.491418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.492842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:32.504386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:32.505345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:32.506328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 529/1054] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:32.511509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.528354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.540020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.619608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6e24a-4cfb-42a8-b729-5836a1b20ef2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.661589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.661908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426d79e-2525-4ccc-affe-f0bfd681b61b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.662747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.663237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.663569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.664876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:32.664876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.666062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.690299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 526/1055] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:32.691293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.702036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.702707 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.702992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.703265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] PATH_INFO: `/v3/services/image` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.703852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.705208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:32.714192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:32.715471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:32.716341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 530/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:32.721115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.725243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.773054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.804730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cad57-ee37-4ac4-b965-1ba5fa469547 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.830013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d1f3-4a54-45db-9272-39f5e585cfd6 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:32.842930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.843565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.843845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.844117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.854158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.855643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.867324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:32.867937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:32.868212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:32.868480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:32.869418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] RBAC: Adding query filter params (name=image) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:32.869799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:32.870669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:32.871607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:32.872517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:32.872517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:32.872517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:32.872692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:32.876574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 527/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:32.881860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 531/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:32.881990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.882670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:32.956392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:32.998056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74660e-8bde-4d83-9263-f60591da5a09 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:33.005846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93948a5c-900e-4fb2-860c-ca159c7283bb None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:33.022550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:33.033809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:33.036749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:33.036749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:33.036749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:33.036749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:33.036749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:33.037217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:33.043030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:33.043646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:33.043928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:33.044202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:33.044837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] RBAC: Adding query filter params (type=image) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:33.045145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:33.046557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:33.050120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 528/1059] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:33.051796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 532/1060] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:33.055470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:33.058172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:33.165312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64697-26de-41cb-8f82-e91d2197e381 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:33.178700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4887-f7aa-4a8b-b138-35b4de8af31f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:33.198117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:33.203893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:33.204498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:33.208154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:33.208154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:33.208154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:33.208154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:33.215090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:33.215740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:33.216019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:33.216292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:33.222995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:33.224429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:33.236725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:33.237807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:33.238867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:33.242586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 529/1061] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:33.243291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:33.284826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 533/1062] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:34:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:33.290260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:33.352562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa82fd-ca03-43ee-a2ad-6598ddbf6767 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:33.397280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:33.398164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:33.398624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:33.399060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:33.399893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:33.400918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:33.402682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c0880-ce28-464b-a468-3b36d2d29546 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:33.415884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 530/1063] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:33.421652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:33.535033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c2b-83ce-4cb1-952c-2416c7c84b0c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:33.570264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5cfeb-cb0d-443b-84fc-2f797e2c58dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:33.570958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cfeb-cb0d-443b-84fc-2f797e2c58dc None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:33.571242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cfeb-cb0d-443b-84fc-2f797e2c58dc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:33.571510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5cfeb-cb0d-443b-84fc-2f797e2c58dc None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/aab0aa1e574a4549a1643bf0674df5c4/roles/2a18cdcd827247d2aad96b8085735cad` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:33.573723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5cfeb-cb0d-443b-84fc-2f797e2c58dc None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=aab0aa1e574a4549a1643bf0674df5c4, role_id=2a18cdcd827247d2aad96b8085735cad)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:33.575181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5cfeb-cb0d-443b-84fc-2f797e2c58dc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:33.650419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 534/1064] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:34:33 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/aab0aa1e574a4549a1643bf0674df5c4/roles/2a18cdcd827247d2aad96b8085735cad => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:34:34.408782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e6d8a-7350-4c15-8c23-f496a6f91bd7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:34.409272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e6d8a-7350-4c15-8c23-f496a6f91bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:34.409272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e6d8a-7350-4c15-8c23-f496a6f91bd7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:34.410754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 531/1065] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:34.416504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:34.416796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:34.417068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:34.435476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:34.436672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:34.482633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:34.505689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 535/1066] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:34.779637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e6d8a-7350-4c15-8c23-f496a6f91bd7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:34.878724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:34.883412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e6d8a-7350-4c15-8c23-f496a6f91bd7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:34.918892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:34.919525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:34.919806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:34.920078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:34.930300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:34.935730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:34.936645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:34.937481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 532/1067] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:34:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:34.942934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:35.046987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541d95-a9a5-408d-9191-af23b4ea45c7 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:35.082541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:35.083160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.083436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.083704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.084364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:35.087652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:35.087652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:35.100806 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 536/1068] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:35.102355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:35.204751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c721604-9fda-4452-9f96-a720a386db75 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:35.238796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc35689-4536-471c-93e2-8ed486dd011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:35.239422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35689-4536-471c-93e2-8ed486dd011d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.239698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35689-4536-471c-93e2-8ed486dd011d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.239968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35689-4536-471c-93e2-8ed486dd011d None admin] PATH_INFO: `/v3/users/6a221168f69c474d9a9269292c951f27` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.253948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35689-4536-471c-93e2-8ed486dd011d None admin] RBAC: Authorizing `identity:get_user(user_id=6a221168f69c474d9a9269292c951f27)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:35.255409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35689-4536-471c-93e2-8ed486dd011d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:35.257219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 533/1069] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:35 2022] GET /identity/v3/users/6a221168f69c474d9a9269292c951f27 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:35.262926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:35.319930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:35.377964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc383c1-f385-46c3-9446-8b10cbe9ee73 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:35.415743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:35.417264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.417542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.417813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.485395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:35.486854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:35.511429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dc9f6-22ef-4351-8cfc-26e218580208 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.511924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dc9f6-22ef-4351-8cfc-26e218580208 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.512003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dc9f6-22ef-4351-8cfc-26e218580208 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.514514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 534/1070] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:35.518750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.519031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.519301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.528420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:35.537792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:35.538999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:35.553863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:35.591405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 537/1071] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:35.597893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:35.623582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 535/1072] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:35.722233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5e17b-91a0-4453-bd62-bd3d72dcaa40 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:35.760532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53432a13-b4a6-4559-a506-435730623051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:35.761543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432a13-b4a6-4559-a506-435730623051 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.762053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432a13-b4a6-4559-a506-435730623051 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.762612 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432a13-b4a6-4559-a506-435730623051 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.763943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53432a13-b4a6-4559-a506-435730623051 None admin] RBAC: Authorizing `identity:get_project(project_id=d8034c58fd73466097a58c5d02f321e8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:35.765816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53432a13-b4a6-4559-a506-435730623051 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:35.772541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 538/1073] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:34:35 2022] GET /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:35.774144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:35.823252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51972a8-9d2f-4ea4-86cf-b782def1c2a5 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.823522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51972a8-9d2f-4ea4-86cf-b782def1c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.823788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51972a8-9d2f-4ea4-86cf-b782def1c2a5 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.825130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 539/1074] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:35.831384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.831876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.832143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.851129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:35.852236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:35.854885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:35.882493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4163251-61a8-4437-955d-af340f37ab45 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:35.917456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:35.918052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:35.918327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:35.918635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:35.919347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=d8034c58fd73466097a58c5d02f321e8, user.id=6a221168f69c474d9a9269292c951f27) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:35.919653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:35.921082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:35.930504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 540/1075] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:35.930504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:35.930787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 536/1076] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:35 2022] GET /identity/v3/role_assignments?user.id=6a221168f69c474d9a9269292c951f27&scope.project.id=d8034c58fd73466097a58c5d02f321e8&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:36.037178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c31b59-d96a-44f6-873e-910f1eeb2bad None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.073640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.074270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.074576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.074851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.089081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:36.151753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:36.153124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:36.194092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:36.209649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:36.262841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 541/1077] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:36.268721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:36.301988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d315bc-5cff-406f-bbd5-d2cce4fc52b9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.316444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:36.339498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.340121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.340399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.340666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.351110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:36.357739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:36.359008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:36.360307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 537/1078] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:36.364873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:36.384268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cbb24-6a2a-4d2a-8662-f5affe953a5e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.422991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.423434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.423709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.423984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.434055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:36.435514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:36.450046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:36.452699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:36.453664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:36.454591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:36.454591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:36.454591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:36.458726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 542/1079] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:36.459951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:36.482097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1d93-00b9-431f-92e0-728e5bc2a44b None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.520845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.521463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.521810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.522075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.522668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:36.522961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:36.524318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:36.532731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 538/1080] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:36.538268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:36.558591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:36.568535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c412-c6f2-470c-a324-94d70000d49c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.607698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.608485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.610262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.610262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.610262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:36.610538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:36.611910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:36.635288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 543/1081] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:36.648325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c315565-141e-4ade-bef6-44ea04884a27 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.686401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.686997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.687272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.687538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.689802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:36.700927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:36.702449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:36.718971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:36.720189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:36.721102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:36.721102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:36.721102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:36.727092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 539/1082] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:36.729482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:36.843017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ec5f7-52eb-4bd4-b847-045a8a5c02c3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:36.889110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:36.889880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:36.890229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:36.891031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:36.891886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:36.892257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:36.893845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:36.908678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 544/1083] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:36.914912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:37.032476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0e08-ea5b-4874-bbbc-93342f81f0e0 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:37.065640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:37.066259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:37.066571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:37.066846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:37.074310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:37.075780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:34:37.086869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:37.088502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:37.094557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 540/1084] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Sep 14 02:34:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:34:37.097319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:37.110528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:37.194456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032641-1a8e-49fa-b27c-734062fafe97 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:37.230879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:37.231481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:37.231756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:37.232022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:37.232736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:37.233038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:37.234482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:37.255106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 545/1085] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Sep 14 02:34:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:37.260969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:37.307546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:37.358783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348c5d-09ab-406b-8a11-a5ad5d17e546 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:37.391146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:37.391740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:37.392014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:37.392281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:37.456361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:37.457784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:37.500873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:37.552847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 541/1086] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:37.559673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:37.626139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:37.659190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56139-3dc6-4228-8278-9b3a58a8cad7 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:37.692563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:37.693229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:37.693511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:37.693781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:37.703717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:37.705151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:34:37.720013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:37.721010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:34:37.722014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:34:37.722014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:34:37.722014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:37.722844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 546/1087] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:37.726931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:37.823352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2595c1-a228-443e-9d80-a5ea06f46e6e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:37.856318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:37.856913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:37.857186 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:37.857447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:37.858072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:37.858367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:37.859808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:37.871190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 542/1088] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:37.876894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:37.982428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6da6a3-5b1f-40dd-8981-0ac152dc40d9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:38.002846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:38.017933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:38.019994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.019994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.019994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.027262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:38.028745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c2ec18bf-5fe1-4bfb-a5a6-1b79760e2b1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:34:38.041453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:38.042688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:38.043597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 547/1089] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:38.048694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:38.058713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:38.125406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d929a-bd46-4fce-81d4-cbba086f788b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.125684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d929a-bd46-4fce-81d4-cbba086f788b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.125955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d929a-bd46-4fce-81d4-cbba086f788b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.127352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 548/1090] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:34:38.132365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.132653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.132932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.148521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2895-7a19-4450-be1d-ea55952ba8be None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:38.151313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:38.152506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:38.180948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:38.181612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.181886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.182153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.182864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:38.183168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:38.184584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:38.201805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 543/1091] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:38.202887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:38.221383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 549/1092] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:38.273652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:38.311057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3f158-64ab-46e6-9d7c-975b0c8f2cc9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:38.345099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:38.345615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.345891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.346161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.346902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] RBAC: Adding query filter params (role.id=2a18cdcd827247d2aad96b8085735cad, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=aab0aa1e574a4549a1643bf0674df5c4) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:38.347210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:38.348622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:38.355133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 544/1093] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:38 2022] GET /identity/v3/role_assignments?user.id=aab0aa1e574a4549a1643bf0674df5c4&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=2a18cdcd827247d2aad96b8085735cad => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:34:38.489596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:38.595384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198bc9b-4d9a-4f08-8989-720e113f60a9 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:38.607245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:38.630317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:38.630978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.631250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.631516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.641710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:38.646737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:38.647698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:34:38.648543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 550/1094] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:38.654707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:38.759149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9603719-5f14-40ff-9ee3-496beed3e55f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:38.789433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:38.795522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:38.796132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.796448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.796801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.797471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:38.797781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:38.799202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:38.808588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 545/1095] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:38.814407 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:38.927183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eecbe-7f56-4420-b675-997a2140c306 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:38.962104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:38.962908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:38.963192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:38.963461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] PATH_INFO: `/v3/users/6a221168f69c474d9a9269292c951f27` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:38.964632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] RBAC: Authorizing `identity:get_user(user_id=6a221168f69c474d9a9269292c951f27)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:38.966065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:38.967709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 551/1096] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:38 2022] GET /identity/v3/users/6a221168f69c474d9a9269292c951f27 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:38.973708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:39.078675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7939-1ade-43d3-bd6e-ddb9bfaf038a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:39.116911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ccd2e-c1dd-4d3f-92fd-0663899c1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:39.117533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ccd2e-c1dd-4d3f-92fd-0663899c1d94 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:39.117809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ccd2e-c1dd-4d3f-92fd-0663899c1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:39.118074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ccd2e-c1dd-4d3f-92fd-0663899c1d94 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:39.119212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ccd2e-c1dd-4d3f-92fd-0663899c1d94 None admin] RBAC: Authorizing `identity:get_project(project_id=d8034c58fd73466097a58c5d02f321e8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:39.120627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ccd2e-c1dd-4d3f-92fd-0663899c1d94 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:39.122256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 546/1097] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:34:38 2022] GET /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:39.128347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:39.170016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:39.229441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6014c0-9b8a-4c3d-9454-abcefaf74da2 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:39.262904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7691dd-9b34-4d3e-aa9c-b3699038c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:39.263564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7691dd-9b34-4d3e-aa9c-b3699038c037 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:39.263844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7691dd-9b34-4d3e-aa9c-b3699038c037 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:39.264119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7691dd-9b34-4d3e-aa9c-b3699038c037 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8/users/6a221168f69c474d9a9269292c951f27/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:39.266277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7691dd-9b34-4d3e-aa9c-b3699038c037 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8034c58fd73466097a58c5d02f321e8, user_id=6a221168f69c474d9a9269292c951f27, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:39.267739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7691dd-9b34-4d3e-aa9c-b3699038c037 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:39.335011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 552/1098] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:34:39 2022] PUT /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8/users/6a221168f69c474d9a9269292c951f27/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:34:41.425353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e547-6757-4225-95be-34cecde2ad1a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:41.425864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e547-6757-4225-95be-34cecde2ad1a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:41.425974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09e547-6757-4225-95be-34cecde2ad1a None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:41.427268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 547/1099] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:41.432692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:41.433101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:41.433236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:41.451045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:41.452211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:41.515646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 553/1100] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:41.784458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09e547-6757-4225-95be-34cecde2ad1a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:41.939554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:41.940933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09e547-6757-4225-95be-34cecde2ad1a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:41.980747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:41.981417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:41.981697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:41.981970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:41.992065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:34:41.997674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:34:41.998811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:34:41.999696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 548/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:34:42.005055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:42.031730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:42.100228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cb013-8704-4b59-9565-5336796a2ab4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:42.133803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:42.134402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:42.134898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:42.135215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:42.135870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:42.136172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:42.137509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:42.145488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 554/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:42.152128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:42.248410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed930717-397e-45e4-a31c-27f0e1f0a895 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:42.268297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:42.282154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:42.282785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:42.283061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:42.283325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] PATH_INFO: `/v3/users/6a221168f69c474d9a9269292c951f27` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:42.284417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] RBAC: Authorizing `identity:get_user(user_id=6a221168f69c474d9a9269292c951f27)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:42.285819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:42.287398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 549/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:42 2022] GET /identity/v3/users/6a221168f69c474d9a9269292c951f27 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:42.293334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:42.380261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:42.389663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c591-7f21-4df4-be18-18e912c3d5ec None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:42.424482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:42.425079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:42.425358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:42.425629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:42.493024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:42.495111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:42.580254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:42.590575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 555/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:42.596666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:42.701172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a844a8-c567-42ca-a63c-239ec0ed86e2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:42.734083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774ff25-4134-4a16-b458-ce5b214331e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:42.734724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ff25-4134-4a16-b458-ce5b214331e1 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:42.735004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ff25-4134-4a16-b458-ce5b214331e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:42.735276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774ff25-4134-4a16-b458-ce5b214331e1 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:42.736375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774ff25-4134-4a16-b458-ce5b214331e1 None admin] RBAC: Authorizing `identity:get_project(project_id=d8034c58fd73466097a58c5d02f321e8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:42.737798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774ff25-4134-4a16-b458-ce5b214331e1 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:42.739444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 550/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:34:42 2022] GET /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:42.745827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:42.843529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79de25b-5b94-4189-87f3-6a2b3a7165c5 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:42.876333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:42.876947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:42.877224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:42.877493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:42.878202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=d8034c58fd73466097a58c5d02f321e8, user.id=6a221168f69c474d9a9269292c951f27) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:42.878546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:42.879951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eea121-1dee-45a9-83e4-e33545162030 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:42.886311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 556/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:42 2022] GET /identity/v3/role_assignments?user.id=6a221168f69c474d9a9269292c951f27&scope.project.id=d8034c58fd73466097a58c5d02f321e8&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:45.063038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca80c-5b4d-4e5e-9faa-284b7c3bb6fc None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:45.063594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca80c-5b4d-4e5e-9faa-284b7c3bb6fc None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:45.063594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aca80c-5b4d-4e5e-9faa-284b7c3bb6fc None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:45.064899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 551/1107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:45.070100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:45.070526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:45.070681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:45.089551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:45.090837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:45.138208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:45.155621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 557/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:45.423544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca80c-5b4d-4e5e-9faa-284b7c3bb6fc None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:45.481051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:45.523575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aca80c-5b4d-4e5e-9faa-284b7c3bb6fc None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:45.561057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceaa8c-9871-47aa-a46e-a88bafa12168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:45.561667 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceaa8c-9871-47aa-a46e-a88bafa12168 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:45.561939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceaa8c-9871-47aa-a46e-a88bafa12168 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:45.562204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceaa8c-9871-47aa-a46e-a88bafa12168 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:45.563326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceaa8c-9871-47aa-a46e-a88bafa12168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:45.564735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceaa8c-9871-47aa-a46e-a88bafa12168 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:45.566273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 552/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:45.572116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:45.664820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecc37f-1d0f-4d01-89b1-276d2726fbfa None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:45.698135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09561fd9-3c06-468f-b639-649b4b815a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:45.698681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561fd9-3c06-468f-b639-649b4b815a11 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:45.698956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561fd9-3c06-468f-b639-649b4b815a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:45.699223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561fd9-3c06-468f-b639-649b4b815a11 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:45.699859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09561fd9-3c06-468f-b639-649b4b815a11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:45.701264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09561fd9-3c06-468f-b639-649b4b815a11 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:45.793152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 558/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:34:45 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:34:47.983771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c60467-a7a5-457a-ba9a-d03c1eceed57 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:47.984301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c60467-a7a5-457a-ba9a-d03c1eceed57 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:47.984301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c60467-a7a5-457a-ba9a-d03c1eceed57 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:47.985658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 553/1111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:47.990890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:47.991328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:47.991446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:48.010321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:48.011535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:48.045148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:48.075998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 559/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:48.349062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c60467-a7a5-457a-ba9a-d03c1eceed57 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:48.446231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c60467-a7a5-457a-ba9a-d03c1eceed57 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:48.469531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:48.479728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:48.486316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:48.486316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:48.486316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] PATH_INFO: `/v3/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:48.486316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] RBAC: Authorizing `identity:get_role(role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:48.486316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:48.486316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 554/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:48 2022] GET /identity/v3/roles/9108424240854e83b07bba15a59c1a63 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:48.490619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:48.587340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5253b20-a401-4a8c-926d-22aec9130a67 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:48.622228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:48.622826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:48.623108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:48.623382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] PATH_INFO: `/v3/users/a39882e046134eb0a51faaa7322d4e56` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:48.636051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] RBAC: Authorizing `identity:get_user(user_id=a39882e046134eb0a51faaa7322d4e56)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:48.637485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:48.639111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 560/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:48 2022] GET /identity/v3/users/a39882e046134eb0a51faaa7322d4e56 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:48.645116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:48.752319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3e27-9b94-4436-954d-2a0d56730e67 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:48.785073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:48.785658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:48.785938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:48.786205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:48.841509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:48.850357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:48.851807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:48.945607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 555/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:48.952074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:48.979140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:49.050188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761273b3-bf57-436b-a425-64c4ec1b2482 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:49.083686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359199d-0e95-4a0f-97c4-e86bb0ecf701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:49.084319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359199d-0e95-4a0f-97c4-e86bb0ecf701 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:49.084594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359199d-0e95-4a0f-97c4-e86bb0ecf701 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:49.084864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359199d-0e95-4a0f-97c4-e86bb0ecf701 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:49.086021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359199d-0e95-4a0f-97c4-e86bb0ecf701 None admin] RBAC: Authorizing `identity:get_project(project_id=d8034c58fd73466097a58c5d02f321e8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:49.087483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359199d-0e95-4a0f-97c4-e86bb0ecf701 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:49.089265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 561/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:34:48 2022] GET /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:49.095465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:49.196659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:49.205862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa575622-e70e-4a72-8894-08108309dd71 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:49.247968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:49.248575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:49.248855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:49.249129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:49.249851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] RBAC: Adding query filter params (role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=d8034c58fd73466097a58c5d02f321e8, user.id=a39882e046134eb0a51faaa7322d4e56) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:49.250159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:49.251642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece0995-1ffd-4931-af26-f7aaa5def054 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:49.257141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 556/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:49 2022] GET /identity/v3/role_assignments?user.id=a39882e046134eb0a51faaa7322d4e56&scope.project.id=d8034c58fd73466097a58c5d02f321e8&role.id=9108424240854e83b07bba15a59c1a63 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:51.466356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354069c-3431-4b12-bbb9-3ad3e6ddc691 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:51.466925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354069c-3431-4b12-bbb9-3ad3e6ddc691 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:51.467031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354069c-3431-4b12-bbb9-3ad3e6ddc691 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:51.468292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 562/1118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:51.473404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:51.473800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:51.473947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:51.492147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:51.493349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:51.558541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 557/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:51.826840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354069c-3431-4b12-bbb9-3ad3e6ddc691 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:51.918105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:51.924607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354069c-3431-4b12-bbb9-3ad3e6ddc691 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:51.957570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:51.958194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:51.958498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:51.958773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] PATH_INFO: `/v3/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:51.960146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] RBAC: Authorizing `identity:get_role(role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:51.961501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:51.963381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 563/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:51 2022] GET /identity/v3/roles/9108424240854e83b07bba15a59c1a63 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:51.969272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:52.050701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:52.065387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec96f1-648b-4ffb-92bd-c4de33a5cef5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:52.098630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:52.099249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:52.099520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:52.099785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] PATH_INFO: `/v3/users/a39882e046134eb0a51faaa7322d4e56` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:52.100874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] RBAC: Authorizing `identity:get_user(user_id=a39882e046134eb0a51faaa7322d4e56)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:52.102289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:52.104475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 558/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:51 2022] GET /identity/v3/users/a39882e046134eb0a51faaa7322d4e56 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:52.110133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:52.205765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472290bd-451d-4990-b726-76d5e4bdd4cd None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:52.238458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51708e59-8502-488a-a963-a91ce2e8860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:52.239099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51708e59-8502-488a-a963-a91ce2e8860a None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:52.239380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51708e59-8502-488a-a963-a91ce2e8860a None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:52.239648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51708e59-8502-488a-a963-a91ce2e8860a None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:52.240753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51708e59-8502-488a-a963-a91ce2e8860a None admin] RBAC: Authorizing `identity:get_project(project_id=d8034c58fd73466097a58c5d02f321e8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:52.242162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51708e59-8502-488a-a963-a91ce2e8860a None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:52.243832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 564/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:34:52 2022] GET /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:52.249909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:52.347943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256795-56c3-41c5-bd0d-e5766e76edb4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:52.380226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c11f39-64c4-4fdd-bbdc-c8022674e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:52.380863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11f39-64c4-4fdd-bbdc-c8022674e4a7 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:52.381139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11f39-64c4-4fdd-bbdc-c8022674e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:52.381406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11f39-64c4-4fdd-bbdc-c8022674e4a7 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8/users/a39882e046134eb0a51faaa7322d4e56/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:52.383522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c11f39-64c4-4fdd-bbdc-c8022674e4a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8034c58fd73466097a58c5d02f321e8, user_id=a39882e046134eb0a51faaa7322d4e56, role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:52.385749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c11f39-64c4-4fdd-bbdc-c8022674e4a7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:52.439209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 559/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:34:52 2022] PUT /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8/users/a39882e046134eb0a51faaa7322d4e56/roles/9108424240854e83b07bba15a59c1a63 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:34:54.607577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4aea-d0fe-4470-85fe-606609786264 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:54.608127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4aea-d0fe-4470-85fe-606609786264 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:54.608127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e4aea-d0fe-4470-85fe-606609786264 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:54.609456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 565/1124] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:54.614883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:54.615283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:54.615419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:54.633272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:54.635045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:54.644184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:54.699944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 560/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:34:54.975853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4aea-d0fe-4470-85fe-606609786264 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:55.005940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:55.076798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e4aea-d0fe-4470-85fe-606609786264 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:55.110005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:55.110690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:55.110969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:55.111240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] PATH_INFO: `/v3/roles/9108424240854e83b07bba15a59c1a63` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:55.112623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] RBAC: Authorizing `identity:get_role(role_id=9108424240854e83b07bba15a59c1a63)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:55.113982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:55.115343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 566/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:54 2022] GET /identity/v3/roles/9108424240854e83b07bba15a59c1a63 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:55.122265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:55.221118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94fdb9-11c5-463c-ba4c-a8b4d20baf36 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:55.255082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:55.255639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:55.255946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:55.256219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] PATH_INFO: `/v3/users/a39882e046134eb0a51faaa7322d4e56` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:55.257328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] RBAC: Authorizing `identity:get_user(user_id=a39882e046134eb0a51faaa7322d4e56)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:55.258777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:55.260831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 561/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:34:55 2022] GET /identity/v3/users/a39882e046134eb0a51faaa7322d4e56 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:55.266934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:55.360008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:55.362933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00527e82-d5d7-4811-8cfa-0a307ba339d9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:55.395545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:55.396137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:55.396414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:55.396682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:55.460424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:55.461838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:55.552557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:55.555924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 567/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:34:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:34:55.562551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:55.577570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:55.661634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5de703-b392-41ef-a807-f049e957fd6b None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:55.695253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365524-b5f6-4d5e-b7e5-b2e9da911a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:55.695861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365524-b5f6-4d5e-b7e5-b2e9da911a77 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:55.696139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365524-b5f6-4d5e-b7e5-b2e9da911a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:55.696411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365524-b5f6-4d5e-b7e5-b2e9da911a77 None admin] PATH_INFO: `/v3/projects/d8034c58fd73466097a58c5d02f321e8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:55.698099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19365524-b5f6-4d5e-b7e5-b2e9da911a77 None admin] RBAC: Authorizing `identity:get_project(project_id=d8034c58fd73466097a58c5d02f321e8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:55.699550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19365524-b5f6-4d5e-b7e5-b2e9da911a77 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:55.701161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 562/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:34:55 2022] GET /identity/v3/projects/d8034c58fd73466097a58c5d02f321e8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:55.707212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:55.800957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e8a95-113c-4762-9ef7-a40c66e432f4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:55.833646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:55.834179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:55.834459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:55.834762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:55.835477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] RBAC: Adding query filter params (role.id=9108424240854e83b07bba15a59c1a63, scope.project.id=d8034c58fd73466097a58c5d02f321e8, user.id=a39882e046134eb0a51faaa7322d4e56) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:34:55.835785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:55.837199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca280fb-a87c-456e-b2c6-277c1142e0a2 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:55.843629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 568/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:34:55 2022] GET /identity/v3/role_assignments?user.id=a39882e046134eb0a51faaa7322d4e56&scope.project.id=d8034c58fd73466097a58c5d02f321e8&role.id=9108424240854e83b07bba15a59c1a63 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:57.972426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ff10-cb35-4ac5-be2a-9c8df1f4edca None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:57.972981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ff10-cb35-4ac5-be2a-9c8df1f4edca None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:57.972981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ff10-cb35-4ac5-be2a-9c8df1f4edca None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:57.974312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 563/1131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:34:57.979396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:57.979796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:57.980038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:57.998893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:34:58.000083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:34:58.059181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:58.067212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 569/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:34:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:34:58.340968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ff10-cb35-4ac5-be2a-9c8df1f4edca None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:58.421944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:34:58.441565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ff10-cb35-4ac5-be2a-9c8df1f4edca None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:58.474925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d928b1c-8254-4718-9676-07b6e001f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:58.475538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928b1c-8254-4718-9676-07b6e001f289 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:58.475816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928b1c-8254-4718-9676-07b6e001f289 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:58.476085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d928b1c-8254-4718-9676-07b6e001f289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:58.477191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928b1c-8254-4718-9676-07b6e001f289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:58.479343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d928b1c-8254-4718-9676-07b6e001f289 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:58.480909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 564/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:34:58.486799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:34:58.582838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a509b-e023-4974-b123-5848217abd3c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:34:58.615530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af759ac-b0a7-48b4-9298-fde6461ea90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:34:58.616071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af759ac-b0a7-48b4-9298-fde6461ea90d None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:34:58.616353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af759ac-b0a7-48b4-9298-fde6461ea90d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:34:58.616627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af759ac-b0a7-48b4-9298-fde6461ea90d None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:34:58.617270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af759ac-b0a7-48b4-9298-fde6461ea90d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:34:58.619231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af759ac-b0a7-48b4-9298-fde6461ea90d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:34:58.707438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 570/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:34:58 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:35:00.889379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27a56-e24c-44ab-bc8c-3e08c7bc62c9 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:00.889909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27a56-e24c-44ab-bc8c-3e08c7bc62c9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:00.889909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27a56-e24c-44ab-bc8c-3e08c7bc62c9 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:00.891607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 565/1135] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:00.896921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:00.897411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:00.897505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:00.916661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:00.917853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:00.957950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:00.983139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 571/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:01.255143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb27a56-e24c-44ab-bc8c-3e08c7bc62c9 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:01.353641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb27a56-e24c-44ab-bc8c-3e08c7bc62c9 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:01.385685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f25315-7144-485c-91c6-88622f98a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:01.386296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25315-7144-485c-91c6-88622f98a67f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:01.386591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25315-7144-485c-91c6-88622f98a67f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:01.386859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25315-7144-485c-91c6-88622f98a67f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:01.387945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25315-7144-485c-91c6-88622f98a67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:01.389382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25315-7144-485c-91c6-88622f98a67f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:01.390946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 566/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:01.396854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:01.492307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c3053-2471-4ba4-82b4-94a87bf95387 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:01.525828 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9a59-cad2-4cdd-bdcd-17f1ede7eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:01.526350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9a59-cad2-4cdd-bdcd-17f1ede7eea5 None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:01.526656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9a59-cad2-4cdd-bdcd-17f1ede7eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:01.526920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9a59-cad2-4cdd-bdcd-17f1ede7eea5 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:01.527567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9a59-cad2-4cdd-bdcd-17f1ede7eea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:01.528962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9a59-cad2-4cdd-bdcd-17f1ede7eea5 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:01.621262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 572/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:35:01 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:35:03.817725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5dc56-fc4f-49fe-9386-5e34f3bcb15f None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:03.818255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5dc56-fc4f-49fe-9386-5e34f3bcb15f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:03.818255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5dc56-fc4f-49fe-9386-5e34f3bcb15f None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:03.819636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 567/1139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:03.824919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:03.825304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:03.825475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:03.843832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:03.845017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:03.870971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:03.911346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 573/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:04.187124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5dc56-fc4f-49fe-9386-5e34f3bcb15f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:04.205276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:04.286365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5dc56-fc4f-49fe-9386-5e34f3bcb15f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:04.320050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:04.320665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:04.320943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:04.321216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:04.331558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:35:04.336453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:04.338745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:35:04.339945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 568/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:04.344285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:04.438592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01207535-e8f4-4616-9ae1-0ed99ef3756c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:04.472657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:04.473253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:04.473526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:04.473792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:04.474442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:04.474802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:04.476143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:04.484123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 574/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:04.489989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:04.565065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:04.586997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41904f29-486b-44d4-952b-f9ea89030f41 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:04.621018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:04.621558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:04.621833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:04.622107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] PATH_INFO: `/v3/users/1a9f920c672f4f85a593bb411dcf26ce` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:04.635176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] RBAC: Authorizing `identity:get_user(user_id=1a9f920c672f4f85a593bb411dcf26ce)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:04.636674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:04.638347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 569/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:35:04 2022] GET /identity/v3/users/1a9f920c672f4f85a593bb411dcf26ce => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:04.644510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:04.669168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:04.739815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5071db-2ce2-4202-a4ef-f4fd045cd3e3 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:04.779374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:04.779969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:04.780245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:04.780512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:04.844672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:04.846105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:04.868330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:04.940717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 575/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:35:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:35:04.947465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:05.043133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec7bbd-4a37-43e6-abca-8f97255c6f7a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:05.079779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318089e-70e1-42d5-bacc-3b72c8c73b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:05.080410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318089e-70e1-42d5-bacc-3b72c8c73b73 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:05.080687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318089e-70e1-42d5-bacc-3b72c8c73b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:05.080957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318089e-70e1-42d5-bacc-3b72c8c73b73 None admin] PATH_INFO: `/v3/projects/6d0b0ecce35249c89268e128c60665a8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:05.082075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318089e-70e1-42d5-bacc-3b72c8c73b73 None admin] RBAC: Authorizing `identity:get_project(project_id=6d0b0ecce35249c89268e128c60665a8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:05.083538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318089e-70e1-42d5-bacc-3b72c8c73b73 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:05.085301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 570/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:35:04 2022] GET /identity/v3/projects/6d0b0ecce35249c89268e128c60665a8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:05.091589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:05.190130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59e7dd-3b06-403d-9116-995ac2a2b458 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:05.213406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:05.223627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:05.227261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:05.227261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:05.227261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:05.227261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=6d0b0ecce35249c89268e128c60665a8, user.id=1a9f920c672f4f85a593bb411dcf26ce) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:05.227261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:05.227261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145430d-dc4e-46ef-a804-b7d0fd83d477 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:05.233327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 576/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:35:05 2022] GET /identity/v3/role_assignments?user.id=1a9f920c672f4f85a593bb411dcf26ce&scope.project.id=6d0b0ecce35249c89268e128c60665a8&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:07.348375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8d0f1-d7e8-4cd7-b31a-5bb6af06b7c1 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:07.348869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8d0f1-d7e8-4cd7-b31a-5bb6af06b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:07.348869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8d0f1-d7e8-4cd7-b31a-5bb6af06b7c1 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:07.350178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 571/1147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:07.355893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:07.356322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:07.356444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:07.375565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:07.376754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:07.441971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 577/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:07.721131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8d0f1-d7e8-4cd7-b31a-5bb6af06b7c1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:07.724048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:07.819004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8d0f1-d7e8-4cd7-b31a-5bb6af06b7c1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:07.852712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:07.854056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:07.854330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:07.854631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:07.864254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:35:07.869113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:07.870279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:35:07.871235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 572/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:07.876375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:07.974261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cf8c5-6370-4c37-aa22-9644b4b544c7 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:07.990984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:08.007613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:08.008211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:08.008489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:08.008759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:08.010525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:08.010833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:08.012300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:08.020658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 578/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:08.026667 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:08.085535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:08.123992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dc87c-39b8-42d7-ad91-2cf8e0cd045a None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:08.155544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:08.156151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:08.156425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:08.156691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] PATH_INFO: `/v3/users/1a9f920c672f4f85a593bb411dcf26ce` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:08.157790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] RBAC: Authorizing `identity:get_user(user_id=1a9f920c672f4f85a593bb411dcf26ce)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:08.159231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:08.160785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 573/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:35:08 2022] GET /identity/v3/users/1a9f920c672f4f85a593bb411dcf26ce => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:08.167147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:08.264118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237786-0de3-4028-be00-19ad7ddd5bdf None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:08.296232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ec50e-7960-4249-80cb-93495b9c865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:08.296851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ec50e-7960-4249-80cb-93495b9c865e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:08.297128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ec50e-7960-4249-80cb-93495b9c865e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:08.297397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ec50e-7960-4249-80cb-93495b9c865e None admin] PATH_INFO: `/v3/projects/6d0b0ecce35249c89268e128c60665a8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:08.298508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ec50e-7960-4249-80cb-93495b9c865e None admin] RBAC: Authorizing `identity:get_project(project_id=6d0b0ecce35249c89268e128c60665a8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:08.299917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ec50e-7960-4249-80cb-93495b9c865e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:08.301533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 579/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:35:08 2022] GET /identity/v3/projects/6d0b0ecce35249c89268e128c60665a8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:08.308181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:08.405834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e049-6d16-4980-9788-87a67b5f2186 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:08.433686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:08.443064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e146-e7bc-4c87-be23-0931eb60781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:08.443707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e146-e7bc-4c87-be23-0931eb60781a None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:08.443986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e146-e7bc-4c87-be23-0931eb60781a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:08.444257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e146-e7bc-4c87-be23-0931eb60781a None admin] PATH_INFO: `/v3/projects/6d0b0ecce35249c89268e128c60665a8/users/1a9f920c672f4f85a593bb411dcf26ce/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:08.446130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e146-e7bc-4c87-be23-0931eb60781a None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0b0ecce35249c89268e128c60665a8, user_id=1a9f920c672f4f85a593bb411dcf26ce, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:08.448451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e146-e7bc-4c87-be23-0931eb60781a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:08.542990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 574/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:35:08 2022] PUT /identity/v3/projects/6d0b0ecce35249c89268e128c60665a8/users/1a9f920c672f4f85a593bb411dcf26ce/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:35:10.663090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a60df3-119c-45d7-8753-8f83b24465bc None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:10.663614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a60df3-119c-45d7-8753-8f83b24465bc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:10.663614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a60df3-119c-45d7-8753-8f83b24465bc None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:10.664956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 580/1154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:10.670328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:10.670749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:10.670900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:10.689224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:10.690380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:10.756291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 575/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:11.027442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a60df3-119c-45d7-8753-8f83b24465bc None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:11.075847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:11.128591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a60df3-119c-45d7-8753-8f83b24465bc None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:11.160211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:11.160822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:11.161096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:11.161362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:11.171994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:35:11.176742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:11.177870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:35:11.178774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 581/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:11.184450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:11.279776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6496f-1ea4-4bd5-8404-f9c8b9e12391 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:11.299421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:11.312918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:11.313512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:11.313793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:11.314067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:11.314756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:11.315063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:11.316424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:11.324463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 576/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:11.330387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:11.426728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1785b-d5e2-4923-90e8-6e4606ccf113 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:11.435461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:11.459221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:11.459911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:11.460197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:11.460470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] PATH_INFO: `/v3/users/1a9f920c672f4f85a593bb411dcf26ce` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:11.461587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] RBAC: Authorizing `identity:get_user(user_id=1a9f920c672f4f85a593bb411dcf26ce)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:11.463661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:11.465235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 582/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:35:11 2022] GET /identity/v3/users/1a9f920c672f4f85a593bb411dcf26ce => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:11.471047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:11.568105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470706ad-8824-4427-916c-33b2823e0f32 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:11.601715 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:11.602310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:11.602626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:11.603525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:11.651406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:11.668851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:11.670296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:11.765837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 577/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:35:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:35:11.772055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:11.869425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a397d08-b4e5-4637-8b6c-fb060bcbc05f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:11.901145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5be821-6e05-43a4-833f-0684c1b4e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:11.901759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be821-6e05-43a4-833f-0684c1b4e08b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:11.902038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be821-6e05-43a4-833f-0684c1b4e08b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:11.902310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5be821-6e05-43a4-833f-0684c1b4e08b None admin] PATH_INFO: `/v3/projects/6d0b0ecce35249c89268e128c60665a8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:11.903439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5be821-6e05-43a4-833f-0684c1b4e08b None admin] RBAC: Authorizing `identity:get_project(project_id=6d0b0ecce35249c89268e128c60665a8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:11.904895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5be821-6e05-43a4-833f-0684c1b4e08b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:11.906578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 583/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:35:11 2022] GET /identity/v3/projects/6d0b0ecce35249c89268e128c60665a8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:11.912444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:11.989113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:12.006390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8855520-717e-480b-be1d-b5e5952fbbf4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:12.039017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:12.039604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:12.039879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:12.040146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:12.041521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=6d0b0ecce35249c89268e128c60665a8, user.id=1a9f920c672f4f85a593bb411dcf26ce) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:12.041824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:12.043257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a022f-765c-47a0-951c-48ccdec2f843 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:12.048800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 578/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:35:11 2022] GET /identity/v3/role_assignments?user.id=1a9f920c672f4f85a593bb411dcf26ce&scope.project.id=6d0b0ecce35249c89268e128c60665a8&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:14.261444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15f09-cfd1-46f3-a708-9c6cc0e771e4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:14.261986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15f09-cfd1-46f3-a708-9c6cc0e771e4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:14.261986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15f09-cfd1-46f3-a708-9c6cc0e771e4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:14.263342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 584/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:14.268842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:14.269254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:14.269375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:14.287579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:14.288737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:14.352716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 579/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:14.622849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15f09-cfd1-46f3-a708-9c6cc0e771e4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:14.668432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:14.720743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15f09-cfd1-46f3-a708-9c6cc0e771e4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:14.753175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:14.753765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:14.754039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:14.754304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:14.822574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:14.824011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:14.865384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:14.919058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 585/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:35:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:35:14.925054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:14.999707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:15.021548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5d17-9107-42d4-a023-ffab98957b82 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:15.054233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:15.054870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:15.055145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:15.055411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:15.062567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:15.063981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-0d9db10b-f11e-41ca-8910-053ae5aa93df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:15.075199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:15.081526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:35:15.082427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 580/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:35:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:15.083288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:15.180280 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce1c6-f7ad-4e0a-b4c0-aad8527ab989 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:15.211833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:15.213001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:15.213272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:15.213537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:15.214165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:15.214496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:15.215829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5e3aa-f282-4b9e-befa-6faab61f31cf None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:15.222734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 586/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Sep 14 02:35:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:17.378222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a57d1-7c66-4c7a-bb26-607eef47eaa8 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:17.378839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a57d1-7c66-4c7a-bb26-607eef47eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:17.378839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a57d1-7c66-4c7a-bb26-607eef47eaa8 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:17.380056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 581/1167] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:17.385429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c09a-f08f-4c1e-a51f-36812d80c22e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:17.385840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c09a-f08f-4c1e-a51f-36812d80c22e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:17.385979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c09a-f08f-4c1e-a51f-36812d80c22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:17.404625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0706c09a-f08f-4c1e-a51f-36812d80c22e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:17.405806 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0706c09a-f08f-4c1e-a51f-36812d80c22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:17.407755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:17.470083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 587/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:17.740836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a57d1-7c66-4c7a-bb26-607eef47eaa8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:17.840701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a57d1-7c66-4c7a-bb26-607eef47eaa8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:17.872983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5dcd5-8bab-4343-8be7-aa42ba26d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:17.873573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5dcd5-8bab-4343-8be7-aa42ba26d06e None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:17.873854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5dcd5-8bab-4343-8be7-aa42ba26d06e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:17.874128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5dcd5-8bab-4343-8be7-aa42ba26d06e None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:17.874813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5dcd5-8bab-4343-8be7-aa42ba26d06e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:17.876185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5dcd5-8bab-4343-8be7-aa42ba26d06e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:17.880785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:17.983915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 582/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Sep 14 02:35:17 2022] POST /identity/v3/domains => generated 267 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:35:20.139166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e315c-381e-48b2-8879-adf5b374538b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:20.139640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e315c-381e-48b2-8879-adf5b374538b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:20.139731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e315c-381e-48b2-8879-adf5b374538b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:20.141056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 588/1170] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:20.146375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:20.146784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:20.146950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:20.165981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:20.167186 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:20.231024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 583/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:20.497530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e315c-381e-48b2-8879-adf5b374538b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:20.595531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e315c-381e-48b2-8879-adf5b374538b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:20.627799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255b2d8-13b4-492f-9698-a242d56656ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:20.628414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b2d8-13b4-492f-9698-a242d56656ca None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:20.628699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b2d8-13b4-492f-9698-a242d56656ca None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:20.628970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b2d8-13b4-492f-9698-a242d56656ca None admin] PATH_INFO: `/v3/domains/930394b5f9b24bca954066888a0b3bdf` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:20.635981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:20.639970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255b2d8-13b4-492f-9698-a242d56656ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=930394b5f9b24bca954066888a0b3bdf)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:20.641399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255b2d8-13b4-492f-9698-a242d56656ca None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:20.643268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 589/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Sep 14 02:35:20 2022] GET /identity/v3/domains/930394b5f9b24bca954066888a0b3bdf => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:20.649043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:20.746317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ae40-c81a-42ee-b2ec-11748c7b9f3e None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:20.771014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:20.779500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b45d-d314-44f8-b7a2-aa7d9f185f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:20.780093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b45d-d314-44f8-b7a2-aa7d9f185f5c None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:20.780368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b45d-d314-44f8-b7a2-aa7d9f185f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:20.780633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b45d-d314-44f8-b7a2-aa7d9f185f5c None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:20.781271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b45d-d314-44f8-b7a2-aa7d9f185f5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:20.782719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b45d-d314-44f8-b7a2-aa7d9f185f5c None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:20.891772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 584/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:35:20 2022] POST /identity/v3/projects => generated 361 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:35:23.062079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09d75-5616-4ac1-9d2f-dda6ec0d192f None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:23.062680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09d75-5616-4ac1-9d2f-dda6ec0d192f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:23.062680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09d75-5616-4ac1-9d2f-dda6ec0d192f None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:23.064040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 590/1174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:23.069289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:23.069668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:23.069839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:23.089071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:23.090395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:23.156516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 585/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:23.441304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09d75-5616-4ac1-9d2f-dda6ec0d192f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:23.539032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09d75-5616-4ac1-9d2f-dda6ec0d192f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:23.576224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90323bca-fc3c-42b5-be44-3dba31df3602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:23.576854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323bca-fc3c-42b5-be44-3dba31df3602 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:23.577127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323bca-fc3c-42b5-be44-3dba31df3602 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:23.577393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323bca-fc3c-42b5-be44-3dba31df3602 None admin] PATH_INFO: `/v3/domains/930394b5f9b24bca954066888a0b3bdf` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:23.578528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90323bca-fc3c-42b5-be44-3dba31df3602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=930394b5f9b24bca954066888a0b3bdf)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:23.579972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90323bca-fc3c-42b5-be44-3dba31df3602 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:23.581537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 591/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Sep 14 02:35:23 2022] GET /identity/v3/domains/930394b5f9b24bca954066888a0b3bdf => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:23.587975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:23.684460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c8c7e-57ef-4896-a2f8-242e83f29cb9 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:23.693276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:23.717237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76073873-9433-42a2-baa4-e6c9cf83e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:23.717846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76073873-9433-42a2-baa4-e6c9cf83e0a4 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:23.718121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76073873-9433-42a2-baa4-e6c9cf83e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:23.718390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76073873-9433-42a2-baa4-e6c9cf83e0a4 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:23.719064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76073873-9433-42a2-baa4-e6c9cf83e0a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:23.720480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76073873-9433-42a2-baa4-e6c9cf83e0a4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:23.810582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 586/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:35:23 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:35:26.032704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06169e6-0b63-4d4b-afe3-c74db5ffc006 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:26.033297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06169e6-0b63-4d4b-afe3-c74db5ffc006 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:26.033297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06169e6-0b63-4d4b-afe3-c74db5ffc006 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:26.034631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 592/1178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:26.039816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:26.040248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:26.040464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:26.058140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:26.059344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:26.125095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 587/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:35:26.394010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06169e6-0b63-4d4b-afe3-c74db5ffc006 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:26.464453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:26.498869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06169e6-0b63-4d4b-afe3-c74db5ffc006 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:26.531390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:26.532002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:26.532278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:26.532545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:26.543256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:35:26.547978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:26.549107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:35:26.550210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 593/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:26.554955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:26.642619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:26.654736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc8910-ab0d-4d27-9289-6737c222060f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:26.682826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:26.683416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:26.683690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:26.683955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:26.684596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:26.684894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:26.686245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:26.693837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 588/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:26.700342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:26.796573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f829bc5-4d87-4f40-b7dc-70580975f253 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:26.821066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:26.829834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:26.830458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:26.830807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:26.831072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] PATH_INFO: `/v3/users/7f6e508d03934207b9eef24e457c0de5` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:26.843864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] RBAC: Authorizing `identity:get_user(user_id=7f6e508d03934207b9eef24e457c0de5)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:26.848089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:26.848089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 594/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:35:26 2022] GET /identity/v3/users/7f6e508d03934207b9eef24e457c0de5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:26.853683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:26.951638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c740647-9b6c-4b4c-b8ed-42c4b87414d2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:26.984154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:26.984748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:26.985029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:26.985302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:27.009303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:27.050957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:27.052395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:27.149142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 589/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:35:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:35:27.155532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:27.254560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c53a5d-fc9f-4c90-ae19-c9d53124dbb9 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:27.287362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940197c-801a-48f6-a507-8c4e80c2020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:27.287978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940197c-801a-48f6-a507-8c4e80c2020c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:27.288277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940197c-801a-48f6-a507-8c4e80c2020c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:27.288545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940197c-801a-48f6-a507-8c4e80c2020c None admin] PATH_INFO: `/v3/projects/61d4db8f60484e03adfb544c0e76d2d9` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:27.289645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940197c-801a-48f6-a507-8c4e80c2020c None admin] RBAC: Authorizing `identity:get_project(project_id=61d4db8f60484e03adfb544c0e76d2d9)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:27.291679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940197c-801a-48f6-a507-8c4e80c2020c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:27.293323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 595/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:35:27 2022] GET /identity/v3/projects/61d4db8f60484e03adfb544c0e76d2d9 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:27.299394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:27.351919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:27.393316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e52a2-d663-46ce-b5d3-ffc2d26553ef None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:27.426479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:27.427078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:27.427357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:27.427628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:27.428338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=61d4db8f60484e03adfb544c0e76d2d9, user.id=7f6e508d03934207b9eef24e457c0de5) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:27.428643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:27.430058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62182fe-7481-48d3-93b7-7560e6cd913a None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:27.435826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 590/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:35:27 2022] GET /identity/v3/role_assignments?user.id=7f6e508d03934207b9eef24e457c0de5&scope.project.id=61d4db8f60484e03adfb544c0e76d2d9&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:35:29.599088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54105-80de-4732-a702-2bf892d04d85 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:29.599663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54105-80de-4732-a702-2bf892d04d85 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:29.599663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54105-80de-4732-a702-2bf892d04d85 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:29.600968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 596/1186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:29.606822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:29.607236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:29.607377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:29.625670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:29.626873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:29.691495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 591/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:35:29.956966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc54105-80de-4732-a702-2bf892d04d85 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:30.009016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:30.054875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc54105-80de-4732-a702-2bf892d04d85 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:30.087908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:30.088526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:30.088799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:30.089064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:30.098948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:35:30.104440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:30.105547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:35:30.106743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 597/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:30.111545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:30.158115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:30.207119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535067-379a-44f7-bb78-c510a5e47bb8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:30.240257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:30.240846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:30.241117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:30.241384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:30.242032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:30.242327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:30.243881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:30.251575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 592/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:30.257395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:30.354425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051c71-dbeb-40fa-8707-3196863d3d51 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:30.366700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:30.386866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:30.387517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:30.387984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:30.388485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] PATH_INFO: `/v3/users/7f6e508d03934207b9eef24e457c0de5` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:30.389589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] RBAC: Authorizing `identity:get_user(user_id=7f6e508d03934207b9eef24e457c0de5)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:30.391039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:30.392850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 598/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:35:30 2022] GET /identity/v3/users/7f6e508d03934207b9eef24e457c0de5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:30.398635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:30.495414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa673d-9960-4a7a-a70d-d14d655b8f34 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:30.507400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:30.529039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dc628-439b-45c8-9cd0-1894a5149c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:30.529652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc628-439b-45c8-9cd0-1894a5149c96 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:30.529926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc628-439b-45c8-9cd0-1894a5149c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:30.530193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc628-439b-45c8-9cd0-1894a5149c96 None admin] PATH_INFO: `/v3/projects/61d4db8f60484e03adfb544c0e76d2d9` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:30.531319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dc628-439b-45c8-9cd0-1894a5149c96 None admin] RBAC: Authorizing `identity:get_project(project_id=61d4db8f60484e03adfb544c0e76d2d9)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:30.532751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dc628-439b-45c8-9cd0-1894a5149c96 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:30.534614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 593/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:35:30 2022] GET /identity/v3/projects/61d4db8f60484e03adfb544c0e76d2d9 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:30.541101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:30.638333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a173-f128-481c-8e37-2b61d26bdec8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:30.671647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f69b45-befc-4c82-a5de-2fd56daddd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:30.672296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69b45-befc-4c82-a5de-2fd56daddd14 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:30.672576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69b45-befc-4c82-a5de-2fd56daddd14 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:30.672846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69b45-befc-4c82-a5de-2fd56daddd14 None admin] PATH_INFO: `/v3/projects/61d4db8f60484e03adfb544c0e76d2d9/users/7f6e508d03934207b9eef24e457c0de5/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:30.674743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f69b45-befc-4c82-a5de-2fd56daddd14 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d4db8f60484e03adfb544c0e76d2d9, user_id=7f6e508d03934207b9eef24e457c0de5, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:30.676159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f69b45-befc-4c82-a5de-2fd56daddd14 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:30.740976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 599/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:35:30 2022] PUT /identity/v3/projects/61d4db8f60484e03adfb544c0e76d2d9/users/7f6e508d03934207b9eef24e457c0de5/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:35:32.908222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf05cdb-960e-4135-aa0e-6db2c3b7bcaa None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:32.908747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf05cdb-960e-4135-aa0e-6db2c3b7bcaa None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:32.908747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf05cdb-960e-4135-aa0e-6db2c3b7bcaa None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:32.910086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 594/1193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:35:32.915591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:32.916033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:32.916134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:32.933871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:35:32.935089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:35:32.969535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:33.001343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 600/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:35:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:35:33.288381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf05cdb-960e-4135-aa0e-6db2c3b7bcaa None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:33.388790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf05cdb-960e-4135-aa0e-6db2c3b7bcaa None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:33.422475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:33.423111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:33.423389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:33.423657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:33.434332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:35:33.439146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:35:33.440311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:35:33.441150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 595/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:35:33.446794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:33.542488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca476-401e-47ee-983d-2c85a9fbada3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:33.575112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:33.575720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:33.575998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:33.576268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:33.576928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:33.577234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:33.578615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:33.586341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 601/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:33.593259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:33.633602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:33.690843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135e29f-9418-47b3-aca7-7bbbf425da42 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:33.724095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:33.724701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:33.724977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:33.725247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] PATH_INFO: `/v3/users/7f6e508d03934207b9eef24e457c0de5` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:33.726345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] RBAC: Authorizing `identity:get_user(user_id=7f6e508d03934207b9eef24e457c0de5)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:33.728114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:33.729479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 596/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Sep 14 02:35:33 2022] GET /identity/v3/users/7f6e508d03934207b9eef24e457c0de5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:33.735158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:33.765388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:33.830357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ef92-e0d7-444c-862d-ee21a0bf4a60 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:33.861362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:33.861947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:33.862222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:33.862507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:33.926367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:33.927833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:33.957351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:34.023496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 602/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:35:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:35:34.029458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:34.124454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8e316-7bab-4341-8fe6-5e7b074071ba None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:34.132784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:34.156677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a9313-75a5-4a0b-818a-12dc57ecfe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:34.157287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a9313-75a5-4a0b-818a-12dc57ecfe2d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:34.157560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a9313-75a5-4a0b-818a-12dc57ecfe2d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:34.157828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a9313-75a5-4a0b-818a-12dc57ecfe2d None admin] PATH_INFO: `/v3/projects/61d4db8f60484e03adfb544c0e76d2d9` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:34.158943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a9313-75a5-4a0b-818a-12dc57ecfe2d None admin] RBAC: Authorizing `identity:get_project(project_id=61d4db8f60484e03adfb544c0e76d2d9)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:34.160357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a9313-75a5-4a0b-818a-12dc57ecfe2d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:34.161955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 597/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Sep 14 02:35:34 2022] GET /identity/v3/projects/61d4db8f60484e03adfb544c0e76d2d9 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:34.168129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:35:34.266060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cbf2-f8aa-4b52-adb1-065adba39aa5 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:35:34.294529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:34.299427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:35:34.300022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:35:34.300298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:35:34.300571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:35:34.301283 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=61d4db8f60484e03adfb544c0e76d2d9, user.id=7f6e508d03934207b9eef24e457c0de5) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:35:34.301590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:35:34.303046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c281-579f-49f8-875c-25bd7bcad194 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:35:34.309194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 603/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:35:34 2022] GET /identity/v3/role_assignments?user.id=7f6e508d03934207b9eef24e457c0de5&scope.project.id=61d4db8f60484e03adfb544c0e76d2d9&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:35:44.164496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=12 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:35:44.336257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:44.466494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b9e1-5577-4ae4-9b67-558c75e8d0d8 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:44.467076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b9e1-5577-4ae4-9b67-558c75e8d0d8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:44.467076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61b9e1-5577-4ae4-9b67-558c75e8d0d8 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:44.468518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 598/1201] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:36:44.473695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:44.474162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:44.474268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:44.492780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:36:44.493958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:36:44.560931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 604/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:36:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:36:44.839457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61b9e1-5577-4ae4-9b67-558c75e8d0d8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:44.943660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61b9e1-5577-4ae4-9b67-558c75e8d0d8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:44.976309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:44.976921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:44.977205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:44.977476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:44.987750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:44.989215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:45.003865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:45.005111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:45.006304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:45.006304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:45.006304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:36:45.006304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 599/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:45.011430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:45.112716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a178-3304-4ca3-9b81-d0f24b051a37 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:45.140310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:45.146253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:45.146892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:45.147171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:45.147443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:45.148076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:45.148379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:45.149722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93ac4-408a-461f-a1d8-82537c91eddb None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:45.161327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 605/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:45.167276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:45.221483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:45.268758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c392-8278-4266-8ca7-2697993ac374 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:45.302341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662a0e9-1fc5-4ffd-a29f-cf44e1651851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:45.302962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a0e9-1fc5-4ffd-a29f-cf44e1651851 None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:45.303242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a0e9-1fc5-4ffd-a29f-cf44e1651851 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:45.303513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662a0e9-1fc5-4ffd-a29f-cf44e1651851 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:45.304148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a0e9-1fc5-4ffd-a29f-cf44e1651851 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:45.305615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662a0e9-1fc5-4ffd-a29f-cf44e1651851 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:45.393016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 600/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Sep 14 02:36:45 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:36:47.539191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e277e1-cb28-44e1-94b2-bbb34e95c8a4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:47.539749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e277e1-cb28-44e1-94b2-bbb34e95c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:47.539749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e277e1-cb28-44e1-94b2-bbb34e95c8a4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:47.541053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 606/1206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:36:47.550257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:47.550728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:47.550833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:47.569578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:36:47.570767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:36:47.636538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 601/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:36:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:36:47.906997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e277e1-cb28-44e1-94b2-bbb34e95c8a4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.006916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e277e1-cb28-44e1-94b2-bbb34e95c8a4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.040701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.041323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.041605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.041875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:48.053562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:36:48.058509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:48.059730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:48.060598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 607/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:48.066381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.105603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:48.164119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91e669-4909-430c-a958-24fef066b8b6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.198598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.199181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.199602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.199897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:48.200634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:48.200934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:48.202333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:48.209955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 602/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:48.216467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.265491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:48.316114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1323-c09f-4df4-8efe-13a70d3928e4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.349514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.350138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.350418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.350721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:48.361693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:48.363162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:48.378043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:48.383758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:48.384759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:48.384759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:48.384759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:48.384759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 608/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:48.385074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.480123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:48.483687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc256-c4f1-4675-9ec2-2b6642c80fe4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.517001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.517610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.517887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.518156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:48.519085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:48.519386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:48.520763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:48.533358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 603/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:48.539208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.638034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae103b91-2c0d-4251-a3bf-04828e44192f None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.639622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:48.671970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.672586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.672859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.673125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:48.681369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:48.682866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:36:48.694759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:48.695914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:48.696886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 609/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:36:48.702387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.802782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04cbf2-884a-4b9a-8d83-48af8361f0d3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.837562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.838155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.838430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.838732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:48.839451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:48.839754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:48.841731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:48.859379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 604/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 14 02:36:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:48.865392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:48.964965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7b2a9-65f1-4a0e-9b1b-334a71f138f1 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:48.998458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:48.999123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:48.999397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:48.999670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:49.028609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:49.064268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:49.065623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:49.163417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 610/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:36:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:36:49.169349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:49.187829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:49.271739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02595ad-2d5d-479e-908b-c5532fa01111 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:49.305588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:49.306197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:49.306493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:49.306766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:49.317128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:49.318517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:49.332925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:49.334168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:49.335367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:49.335367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:49.335367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:36:49.335367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 605/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:49.339883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:49.399289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:49.436904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d36de-09b4-4e11-ad71-3f07dd0c5c59 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:49.469967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:49.470592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:49.470865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:49.471134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:49.471803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:49.472102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:49.473448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:49.485054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 611/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:49.490952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:49.561611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:49.593280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14cd8a-acc8-42ab-9c6c-f2d775a163c2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:49.628441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:49.629057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:49.629335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:49.629606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:49.636094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:49.638594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:36:49.649833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:49.650949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:36:49.652039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 606/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:49.656924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:49.755316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed6760-d2b2-4535-be3f-a912e3bbe449 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:49.777647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:49.788933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:49.789531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:49.789820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:49.790078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:49.790849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:49.791147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:49.792560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5dad3-93c8-4836-b84b-a9876240d694 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:49.804218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 612/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:49.811161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:49.910900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf788f4-d7b8-4ae3-a3b3-b974ba3cbef3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:49.939232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:49.944976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545966a-b419-43db-8995-55add729635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:49.945566 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545966a-b419-43db-8995-55add729635d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:49.945837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545966a-b419-43db-8995-55add729635d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:49.946102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545966a-b419-43db-8995-55add729635d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:49.946836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545966a-b419-43db-8995-55add729635d None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=01bcb3dcd2054cc3a8f03990d4dc0781) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:49.947225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545966a-b419-43db-8995-55add729635d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:49.948828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545966a-b419-43db-8995-55add729635d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:49.954618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 607/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:36:49 2022] GET /identity/v3/role_assignments?user.id=01bcb3dcd2054cc3a8f03990d4dc0781&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:52.195739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602bea-4a1a-4424-8079-b810cbe5b564 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:52.196279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602bea-4a1a-4424-8079-b810cbe5b564 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:52.196279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602bea-4a1a-4424-8079-b810cbe5b564 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:52.197616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 613/1220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:36:52.203329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:52.203770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:52.203914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:52.222605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:36:52.223788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:36:52.290215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 608/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:36:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:36:52.559841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602bea-4a1a-4424-8079-b810cbe5b564 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:52.663620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602bea-4a1a-4424-8079-b810cbe5b564 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:52.696621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:52.697240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:52.697512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:52.697780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:52.707514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:36:52.712297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:52.713402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:52.714506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 614/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:52.720052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:52.817093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499191da-c0fc-4c15-befd-1b2d1e74fdc1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:52.840714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:52.850961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:52.851564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:52.851844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:52.852114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:52.852769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:52.853072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:52.854437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:52.862263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 609/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:52.868091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:52.913539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:52.969638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0b5f-e53e-499a-ab35-dc99b2675110 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.004284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.004912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.005206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.005463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.015778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.017204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:53.032172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:53.033302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:53.034251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:53.034251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:53.034251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:53.034251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 615/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:53.039096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:53.146948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240abc0-ff4b-4a0e-b0fa-f34b86e31cb3 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.179780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.180366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.180639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.180904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.181531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:53.181826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.183208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:53.194599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 610/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:53.201221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:53.293533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:53.300851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f844add-0d09-4f14-9c5a-fa382fd69657 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.334484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.335124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.335401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.335662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.343059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.346987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:36:53.355807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:53.357021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:53.358164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 616/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:36:53.362985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:53.411548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:53.465086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e63fa-0fa0-4212-aa24-1d3c1e52cc0b None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.502587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.503184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.503463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.503733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.504448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:53.504754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.506177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:53.523778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 611/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 14 02:36:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:53.529996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:53.631308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2860d2f-a5c1-4283-9cee-d2544196fa2c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.664777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.665406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.665683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.665954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.677227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.678679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:53.693353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:53.694500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:53.695694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:53.695694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:53.695694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:53.695694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 617/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:53.700466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:53.798712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c426757-63e3-4847-8d07-435057f568b7 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.801012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:53.831780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.832377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.832656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.832926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.833559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:53.833862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.835261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:53.846398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 612/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:53.851936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:53.861769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:53.951128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ed34-bcfc-4dd1-98fc-4063e9625788 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:53.983645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:53.984258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:53.984534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:53.984795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:53.991443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:53.992885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:36:54.004616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:54.005726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:54.006878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 618/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:54.011595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:54.115112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33dc0c-a42e-44ed-a560-3a0aed4fd7a2 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:54.149948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:54.150649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:54.150932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:54.151202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:54.151888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:54.152194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:54.153724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3d79e-fd1f-4f3c-a8d8-9bef0f80ac39 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:54.165636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 613/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:36:54.171921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:54.236594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:54.271071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37865-62a7-4b5f-935b-109e18291db1 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:54.302637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8e86b-8399-48ae-8e16-78b5e469c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:54.303285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e86b-8399-48ae-8e16-78b5e469c4b3 None admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:54.303568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e86b-8399-48ae-8e16-78b5e469c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:54.303845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8e86b-8399-48ae-8e16-78b5e469c4b3 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/01bcb3dcd2054cc3a8f03990d4dc0781/roles/cfce36666e244da9b67aa3d8342f2fbb` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:54.318608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e86b-8399-48ae-8e16-78b5e469c4b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=01bcb3dcd2054cc3a8f03990d4dc0781, role_id=cfce36666e244da9b67aa3d8342f2fbb)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:54.320039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8e86b-8399-48ae-8e16-78b5e469c4b3 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:54.385819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 619/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:36:54 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/01bcb3dcd2054cc3a8f03990d4dc0781/roles/cfce36666e244da9b67aa3d8342f2fbb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:36:56.557200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d2258-9f1d-4fdd-8e0a-afd2f7381ddd None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:56.557747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d2258-9f1d-4fdd-8e0a-afd2f7381ddd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:56.557747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d2258-9f1d-4fdd-8e0a-afd2f7381ddd None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:56.559816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 614/1233] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:36:56.565272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:56.565749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:56.565843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:56.584556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:36:56.585786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:36:56.656142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 620/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:36:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:36:56.927676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d2258-9f1d-4fdd-8e0a-afd2f7381ddd None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:56.953232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:57.028020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d2258-9f1d-4fdd-8e0a-afd2f7381ddd None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:57.062191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:57.062859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:57.063125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:57.063396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:57.073379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:36:57.079090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:57.080333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:36:57.082195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 615/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Sep 14 02:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:57.086756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:57.132014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:57.182823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e61023-aead-47e2-8f05-7b9bbeadd59f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:57.222847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:57.223463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:57.223740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:57.224009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:57.224664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] RBAC: Adding query filter params (name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:57.224984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:57.226352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:57.234242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 621/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Sep 14 02:36:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:36:57.240142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:57.323650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:57.344675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed120677-8f07-459b-8145-8094e03f96b6 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:57.378889 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:57.379501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:57.379774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:57.380044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:57.390680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:57.392117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:57.406986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:57.408149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:57.409064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:57.409064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:57.409064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:36:57.409064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 616/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:57.414099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:57.515791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c842aa-b4d4-4ca9-80e6-7ff53c86e1ba None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:57.524800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:57.549174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:57.549781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:57.550107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:57.550385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:57.551049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:57.551351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:57.552704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:57.564749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 622/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:57.570607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:57.675480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f439eb-a2ee-48d8-b272-8e189fb30028 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:57.712644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:57.713272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:57.713591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:57.713847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:57.717309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:57.722180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:57.723765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:36:57.734888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:57.735977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:36:57.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 617/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:57.741943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:57.845115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913f275-1546-45c6-b276-52e751be1b3d None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:57.879003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:57.879603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:57.879882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:57.880150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:57.880863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:57.881175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:57.882621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:57.900338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 623/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 14 02:36:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:57.906294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:58.007825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b6b29-5f41-4617-84ae-e36d3c51bb1f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:58.041410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:58.041998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:58.042309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:58.042606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:58.108241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:58.109575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:58.111057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:58.207227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 618/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:36:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 02:36:58.213114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:58.241111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:58.313198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f665-d07f-411c-9c40-ef20047eedd8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:58.346241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:58.346897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:58.347179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:58.348962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:58.357769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:58.359297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:36:58.373836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:58.374867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:36:58.375784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:36:58.375784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:36:58.375784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:58.375784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 624/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:58.381136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:58.474484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:58.480144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc844-5b23-4690-b927-156b35cd149d None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:58.513964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:58.514593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:58.514876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:58.515153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:58.515782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:58.516082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:58.517506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:58.529174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 619/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:58.534837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:58.612984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:36:58.634308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f0d3-7e8a-48ea-91bd-a88cb9f03a15 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:58.667817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:58.669069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:58.669348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:58.669616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:58.676343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:58.677795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:36:58.689832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:36:58.690925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:36:58.691979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 625/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:36:58.696880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:58.796646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afda2f8-0484-4286-9388-3c2b9bfd0900 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:58.829935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:58.830558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:58.830886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:58.831163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:58.831844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:58.832146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:58.833586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332486d-4d44-4796-9b3b-4547d3f7d1fb None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:58.845241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 620/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:36:58.851908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:36:58.955129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b30ad0-4b5b-469b-aaec-25278a06cc7e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:36:58.988182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:36:58.988776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:36:58.989054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:36:58.989324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:36:58.990033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] RBAC: Adding query filter params (role.id=cfce36666e244da9b67aa3d8342f2fbb, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=01bcb3dcd2054cc3a8f03990d4dc0781) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:36:58.990337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:36:58.991788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc49578-d0cd-457b-9a6e-06f9991c0c11 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:36:58.998006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 626/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:36:58 2022] GET /identity/v3/role_assignments?user.id=01bcb3dcd2054cc3a8f03990d4dc0781&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=cfce36666e244da9b67aa3d8342f2fbb => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:01.181429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade6ce-936f-4485-802c-3d3ef00be454 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:01.181963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade6ce-936f-4485-802c-3d3ef00be454 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:01.181963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade6ce-936f-4485-802c-3d3ef00be454 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:01.183361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 621/1247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:37:01.189237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:01.189624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:01.189782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:01.196194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:01.208334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:01.209526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:01.277163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 627/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:37:01.551470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ade6ce-936f-4485-802c-3d3ef00be454 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:01.569288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:01.660432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ade6ce-936f-4485-802c-3d3ef00be454 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:01.693678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:01.694296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:01.694596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:01.694866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:01.705269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:37:01.710138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:01.711368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:37:01.712215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:01.718101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:01.718698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 622/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:01.818446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23c89f-2393-49d1-8857-e53ecfed032b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:01.847381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:01.851975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:01.852574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:01.852848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:01.853114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:01.853759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:01.854053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:01.855408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:01.863242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 628/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:37:01.869086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:01.947614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:01.972468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495fb44-99e1-4047-a2fd-b8e3f61b4078 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:02.005671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:02.006288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:02.006598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:02.006873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:02.018371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:02.022021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:37:02.042815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:02.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:37:02.056983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:37:02.056983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:02.056983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:02.056983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 623/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:02.057221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:02.148485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38b227-f738-4ce3-9dbb-e975dad088ac None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:02.181223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:02.181824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:02.182101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:02.182370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:02.183035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:02.183335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:02.184835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:02.196439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 629/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:02.202997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:02.304793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f81d8c-f6ac-416d-a916-17acb905591b None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:02.331709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:02.339311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:02.339878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:02.340150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:02.340419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:02.347830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:02.349341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:37:02.360606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:02.365008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:02.366250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 624/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:02.369594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:02.426061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:02.468501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1d9f1-27ee-4198-9a86-10b327c3e9c8 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:02.501646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:02.502241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:02.502539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:02.502810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:02.503522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:02.503824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:02.505236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:02.524014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 630/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 14 02:37:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:02.530111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:02.627887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f575a-10f6-477f-8d63-a9dd868ae8ed None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:02.661379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:02.661959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:02.662237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:02.662531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:02.715958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:02.729526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:02.731156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:02.833822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 625/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:37:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:37:02.839697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:02.939399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6463ef-af64-4d28-a86f-ff3e639b3513 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:02.952650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:02.973617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:02.974275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:02.974585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:02.974855 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:02.985121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:02.986598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:37:03.002724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:03.003897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:37:03.004826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:37:03.004826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:03.004826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:03.004826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 631/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:03.009692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:03.110236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:03.122373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87781a6-e231-4979-8ec9-f0649f724eb4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:03.157622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:03.158221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:03.158524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:03.158797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:03.159427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:03.159796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:03.161131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:03.172956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 626/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:03.178636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:03.283060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e7e8-d305-4cfa-bf44-d98bce95ee9e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:03.316579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:03.317200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:03.317483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:03.317754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:03.324228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:03.326195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:37:03.337371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:03.339982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:03.340896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 632/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:03.345225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:03.452700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a51b6-3be8-403f-a5d7-f62fb9533ef4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:03.486305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:03.486934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:03.487218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:03.487496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:03.488172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:03.488473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:03.489947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f1a8-c84e-4332-9f48-766022beb211 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:03.501971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 627/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:03.508082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:03.534544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:03.609340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6db8d-4ed9-4e00-8c7a-ec16cd203fbc None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:03.644288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:03.645122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:03.645398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:03.645664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:03.646376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=01bcb3dcd2054cc3a8f03990d4dc0781) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:03.646720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:03.648119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4c3d0-bc0a-4972-9f32-d8c9700dca07 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:03.653614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 633/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:37:03 2022] GET /identity/v3/role_assignments?user.id=01bcb3dcd2054cc3a8f03990d4dc0781&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=71e577fde5844b97bf565dd6010625e6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:05.758122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f257e-691b-4d83-9b99-34f47df996cf None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:05.758707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f257e-691b-4d83-9b99-34f47df996cf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:05.758707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f257e-691b-4d83-9b99-34f47df996cf None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:05.760063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 628/1261] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:37:05.765435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:05.765845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:05.766003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:05.785126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:05.786335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:05.853140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 634/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:37:06.131393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f257e-691b-4d83-9b99-34f47df996cf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:06.142529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:06.241267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f257e-691b-4d83-9b99-34f47df996cf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:06.275758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:06.276382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:06.276679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:06.276940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:06.289324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:37:06.295143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:06.296363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:06.297334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 629/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:06.302780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:06.322506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:06.411265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499370-3ba8-484b-aa23-8292a8efa317 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:06.448338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:06.448954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:06.449235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:06.449511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:06.450181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:06.451063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:06.452438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:06.461237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 635/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:06.467971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:06.541543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:06.574782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e46d6-1bbd-4b6b-9fcf-bd98a10210cd None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:06.611561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:06.612186 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:06.612465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:06.612733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:06.622996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:06.624549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:37:06.639770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:06.640934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:37:06.642220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:37:06.642220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:06.642220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:06.642220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 630/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 02:37:06.647251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:06.734967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:06.756303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5538c-d25c-40d3-a67f-7fcf81eaca6b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:06.791191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:06.791818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:06.792054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:06.792321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:06.792952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:06.793250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:06.794675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:06.806195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 636/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:06.812574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:06.909521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa23b-3657-4541-91c3-c0594c6ec85e None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:06.928286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:06.942153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:06.942796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:06.943072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:06.943343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:06.950987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:06.952522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:37:06.963262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:06.969165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:06.970192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 631/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:06.970827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:07.068653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29adc8b-a5b2-46f4-a075-a60673d2b73e None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:07.102647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:07.103250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:07.103524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:07.103790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:07.104535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:07.104834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:07.106245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:07.115296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:07.124181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 637/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 14 02:37:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:07.130119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:07.232459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3335d-9fc5-4738-a564-3c7f01048db6 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:07.266238 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:07.266938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:07.267222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:07.267488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:07.278044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:07.279530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:37:07.293259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:07.294950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:37:07.296211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:37:07.296211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:07.296211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:07.296211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 632/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:07.300916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:07.398955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046494b-13dd-42f3-b19f-583e83022e9c None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:07.432433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:07.433038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:07.433318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:07.433591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:07.434221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:07.434552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:07.436522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:07.447367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 638/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:07.453361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:07.486139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:07.552817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78620ccf-5b84-4cc4-a92b-ef9956f9d489 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:07.585931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:07.586572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:07.586848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:07.587112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:07.594180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:07.595660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:37:07.606609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:07.608252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:07.609519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 633/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:07.614258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:07.670756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:07.718664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634182a6-27a1-474c-83b0-a6310a10228b None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:07.751928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:07.752553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:07.752831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:07.753098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:07.753777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:07.754079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:07.755531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f84e0-b7d8-430a-b2d7-20c9eab83f79 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:07.767391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 639/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:07.773673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:07.863723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:07.872144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa1573-e3c6-43c6-8929-48f1fd6325e4 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:07.905502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3dbc1-3400-4125-9a00-e531e50ac397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:07.906140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3dbc1-3400-4125-9a00-e531e50ac397 None admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:07.906415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3dbc1-3400-4125-9a00-e531e50ac397 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:07.906714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3dbc1-3400-4125-9a00-e531e50ac397 None admin] PATH_INFO: `/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/01bcb3dcd2054cc3a8f03990d4dc0781/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:07.908557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3dbc1-3400-4125-9a00-e531e50ac397 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a636ce482b24a09a051c2c70ab78db4, user_id=01bcb3dcd2054cc3a8f03990d4dc0781, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:07.909967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3dbc1-3400-4125-9a00-e531e50ac397 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:07.992442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 634/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Sep 14 02:37:07 2022] PUT /identity/v3/projects/0a636ce482b24a09a051c2c70ab78db4/users/01bcb3dcd2054cc3a8f03990d4dc0781/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:37:10.124838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613875-b152-43b2-bd56-cff674398c55 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:10.125337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613875-b152-43b2-bd56-cff674398c55 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:10.125428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613875-b152-43b2-bd56-cff674398c55 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:10.126772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 640/1274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:37:10.131869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:10.132242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:10.132449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:10.151449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:10.152612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:10.219551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 635/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:37:10.494340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613875-b152-43b2-bd56-cff674398c55 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:10.600881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613875-b152-43b2-bd56-cff674398c55 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:10.617759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:10.634793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:10.635413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:10.635691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:10.635960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:10.646932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 02:37:10.651788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:10.652983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:10.654189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 641/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Sep 14 02:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:10.661093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:10.750591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:10.768351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f537c-0854-4745-a187-272dd78941d5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:10.801339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:10.801960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:10.802234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:10.802527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:10.803180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:10.803479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:10.804834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:10.813790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 636/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Sep 14 02:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:10.819742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:10.918089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f239d-2464-414a-9b64-6860924aa1c4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:10.952443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:10.953064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:10.953352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:10.953620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:10.963537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:10.965001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:37:10.979406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:10.980584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:37:10.982250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:37:10.982250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:10.982250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:10.982250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 642/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:10.986930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:11.090456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a8ab4-7358-42ef-a8a6-e076b621c9ca None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:11.124851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:11.125449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:11.125720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:11.125987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:11.126643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:11.126943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:11.128306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:11.139745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 637/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:11.145983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:11.177371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:11.244709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458047-43c4-468d-9ddb-69ab5b8def56 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:11.277650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:11.278259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:11.278614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:11.278922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:11.285972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:11.287413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 02:37:11.298159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:11.299326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:11.300321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 643/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:11.305299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:11.309042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:11.407838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3600df7-1278-45d3-b95d-5d8ca0684c15 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:11.445531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:11.446152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:11.446424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:11.446720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:11.447432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:11.447755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:11.449258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:11.466990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 638/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Sep 14 02:37:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:11.472817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:11.563991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:11.573275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b419-b44d-4e54-9bf2-5ea984cb2556 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:11.605307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:11.605912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:11.606195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:11.606490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:11.675679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:11.677116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:11.774079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:11.784546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 644/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Sep 14 02:37:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 02:37:11.790386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:11.850710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:11.887970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f205e-04c8-4e6c-968e-bce1a503f524 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:11.922109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:11.922758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:11.923037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:11.923309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:11.933078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:11.934550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 02:37:11.949262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:11.950349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 02:37:11.951386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 02:37:11.951386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 02:37:11.951386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:11.951386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 639/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:11.956430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:12.054428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ef40d-4564-4b38-978f-9231b4876905 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:12.088523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:12.089051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:12.089327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:12.089598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:12.090237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:12.090574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:12.092595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:12.103844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 645/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Sep 14 02:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:12.110399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:12.208086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498a37-13ce-4af4-aa92-8a7366412ff9 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:12.222040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:12.242336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:12.242985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:12.243266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:12.243576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:12.250534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:12.251967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 02:37:12.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:12.264529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: ERROR keystone.server.flask.application Sep 14 02:37:12.270652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 640/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Sep 14 02:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:12.271256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:12.323175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:12.373658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41576ef-6e38-4789-ae69-74804c9dd0c4 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:12.408607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:12.409210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:12.409492 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:12.409765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:12.410635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:12.410941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:12.412366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea154e-1fcf-4e78-b8fb-549d90a49c4d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:12.425158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 646/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Sep 14 02:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:12.431491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:12.531623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6592b30-411d-4140-b365-2bb5c2020a6f None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:12.564692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:12.565284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:12.565559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:12.565827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:12.566569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] RBAC: Adding query filter params (role.id=71e577fde5844b97bf565dd6010625e6, scope.project.id=0a636ce482b24a09a051c2c70ab78db4, user.id=01bcb3dcd2054cc3a8f03990d4dc0781) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:12.566874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:12.568290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9982c-e04a-477e-bd65-8f6494798766 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:12.573954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 641/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Sep 14 02:37:12 2022] GET /identity/v3/role_assignments?user.id=01bcb3dcd2054cc3a8f03990d4dc0781&scope.project.id=0a636ce482b24a09a051c2c70ab78db4&role.id=71e577fde5844b97bf565dd6010625e6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:37:14.728305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29ac2-160d-4ba2-8bc3-c7901c619f5b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:14.728880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29ac2-160d-4ba2-8bc3-c7901c619f5b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:14.728880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29ac2-160d-4ba2-8bc3-c7901c619f5b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:14.730229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 647/1288] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:37:14.735985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:14.736402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:14.736584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:14.755043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:14.756224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:14.784690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:14.821701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 642/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:37:15.102657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29ac2-160d-4ba2-8bc3-c7901c619f5b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:15.201437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e29ac2-160d-4ba2-8bc3-c7901c619f5b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:15.212151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:15.235339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:15.235958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:15.236282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:15.236556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:15.237130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:15.238512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:15.247058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:15.248558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:15.249750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 648/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:37:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:15.254165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:15.351745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cc7b-bc4a-487d-96f1-887ab4337a3e None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:15.384688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:15.385321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:15.385601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:15.385873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:15.386517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:15.386827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:15.388255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e008-c469-49cc-8198-01b3912f4f26 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:15.393005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 643/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 14 02:37:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:15.399113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:15.496400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e34b-98f4-47f7-8fd2-a49fd5f7f108 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:15.529624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:15.530232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:15.530540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:15.530814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] PATH_INFO: `/v3/services` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:15.531438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] RBAC: Adding query filter params (type=placement) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:15.531742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:15.533093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965de16-ca83-498f-9b2b-361d70ed137d None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:15.537418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 649/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 14 02:37:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:17.674227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51288016-6684-4eb0-b0fc-a35bc63be3b1 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:17.674810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51288016-6684-4eb0-b0fc-a35bc63be3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:17.674810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51288016-6684-4eb0-b0fc-a35bc63be3b1 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:17.676148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 644/1293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:37:17.681503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24213-02f1-4d0d-9aa4-668858f9a1f0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:17.681917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24213-02f1-4d0d-9aa4-668858f9a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:17.682031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab24213-02f1-4d0d-9aa4-668858f9a1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:17.699769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-fab24213-02f1-4d0d-9aa4-668858f9a1f0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:17.701674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fab24213-02f1-4d0d-9aa4-668858f9a1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:17.730422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:17.771549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 650/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 02:37:18.040755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51288016-6684-4eb0-b0fc-a35bc63be3b1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:18.071603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:18.149194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51288016-6684-4eb0-b0fc-a35bc63be3b1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:18.181733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bf16f-fbba-44f8-8d30-cffcb362d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:18.182320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bf16f-fbba-44f8-8d30-cffcb362d37f None admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:18.182625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bf16f-fbba-44f8-8d30-cffcb362d37f None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:18.182894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bf16f-fbba-44f8-8d30-cffcb362d37f None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:18.183526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bf16f-fbba-44f8-8d30-cffcb362d37f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:18.185427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bf16f-fbba-44f8-8d30-cffcb362d37f None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:18.238041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 645/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Sep 14 02:37:18 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:37:20.404753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242a39-1b6a-49fd-b3b4-dd6bc2eaf9d0 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:20.405265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242a39-1b6a-49fd-b3b4-dd6bc2eaf9d0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:20.405265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242a39-1b6a-49fd-b3b4-dd6bc2eaf9d0 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:20.406566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 651/1296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:37:20.411808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:20.412222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:20.412338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:20.430055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:20.431322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:20.502374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 646/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:37:20.771074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242a39-1b6a-49fd-b3b4-dd6bc2eaf9d0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:20.869334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242a39-1b6a-49fd-b3b4-dd6bc2eaf9d0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:20.902322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:20.902974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:20.903250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:20.904169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:20.904965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:20.906323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:20.914908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:20.917421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:20.918494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 652/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:37:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:20.922114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:20.940820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:21.020576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fd49c-67b9-48ef-a85d-1c4a45f0924c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:21.054078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:21.054636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:21.054916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:21.055187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:21.055804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:21.056105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:21.057463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:21.063332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 647/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 14 02:37:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:21.069531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:21.102575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:21.169021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cfa73-b83c-4b2a-a004-6091d2064642 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:21.203240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:21.203895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:21.204194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:21.204459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:21.205148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] RBAC: Adding query filter params (interface=public, service_id=3f460568f0494f02af401cca2d022561, region_id=RegionOne) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:21.205451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:21.206835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4a446-c4fe-47ae-be5f-773ee464f89c None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:21.211956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 653/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Sep 14 02:37:21 2022] GET /identity/v3/endpoints?service_id=3f460568f0494f02af401cca2d022561&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:21.218014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:21.299284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:21.317437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57367ce-ee01-4e63-b566-397bb9037437 None admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:21.351495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1061d-ea81-45b6-ac99-d09508f1b105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:21.352093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1061d-ea81-45b6-ac99-d09508f1b105 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:21.352370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1061d-ea81-45b6-ac99-d09508f1b105 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:21.352639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1061d-ea81-45b6-ac99-d09508f1b105 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:21.353237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1061d-ea81-45b6-ac99-d09508f1b105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:21.354620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1061d-ea81-45b6-ac99-d09508f1b105 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:21.362320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 648/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Sep 14 02:37:21 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:37:23.501159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363b359-7aac-43c5-8fa0-ceddb27931ab None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:23.501686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363b359-7aac-43c5-8fa0-ceddb27931ab None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:23.501686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363b359-7aac-43c5-8fa0-ceddb27931ab None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:23.503086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 654/1302] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:37:23.508310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:23.508718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:23.508849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:23.527095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:37:23.528257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:37:23.594388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 649/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:37:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 02:37:23.861240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363b359-7aac-43c5-8fa0-ceddb27931ab None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:23.954489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:23.960830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363b359-7aac-43c5-8fa0-ceddb27931ab None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:23.993139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:23.993754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:23.994027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:23.994294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:23.994902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:23.996243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 02:37:24.005330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 02:37:24.009137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application with Lock( Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self._enter() Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application return self.creator() Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application created_value = creator( Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: ERROR keystone.server.flask.application Sep 14 02:37:24.010224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 655/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Sep 14 02:37:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 02:37:24.012777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:24.088548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:24.119072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67dad9-0239-4be4-93ff-fbef24464ba3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:24.160922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:24.161516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:24.161858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:24.162129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] PATH_INFO: `/v3/services` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:24.162850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:37:24.163154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:24.164510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e652f4-afbb-4699-8b3c-97d1562c94a8 None admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:24.170373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 650/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Sep 14 02:37:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:37:24.176231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:37:24.273098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54bc22-04e2-4ec1-a20d-f61a31142f92 None admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:37:24.306922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71317e1-c31b-48ff-809f-3e862134217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:37:24.307528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71317e1-c31b-48ff-809f-3e862134217f None admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:37:24.307807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71317e1-c31b-48ff-809f-3e862134217f None admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:37:24.308075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71317e1-c31b-48ff-809f-3e862134217f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:37:24.308735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71317e1-c31b-48ff-809f-3e862134217f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:37:24.310120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71317e1-c31b-48ff-809f-3e862134217f None admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:37:24.409767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 656/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:37:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:37:34.301179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=30 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:37:34.405087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:17.757054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc2b5e-9024-4a6b-9362-eb0d9fa45784 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:17.758376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc2b5e-9024-4a6b-9362-eb0d9fa45784 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:17.759250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc2b5e-9024-4a6b-9362-eb0d9fa45784 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:17.764609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 651/1307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:17.767232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0be7-e79d-4d31-aac0-ad330904ca78 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:17.767684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0be7-e79d-4d31-aac0-ad330904ca78 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:17.767944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0be7-e79d-4d31-aac0-ad330904ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:17.865679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-dd2c0be7-e79d-4d31-aac0-ad330904ca78 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:17.867025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dd2c0be7-e79d-4d31-aac0-ad330904ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:18.094849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 657/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:18.407687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768161-c630-4240-aef8-aca9ec92cc19 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:18.408032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768161-c630-4240-aef8-aca9ec92cc19 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:18.408224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768161-c630-4240-aef8-aca9ec92cc19 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:18.409908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 652/1309] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 14 02:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:18.416114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da9ef-7a98-45c8-bddf-6c5b5f64e825 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:18.416435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da9ef-7a98-45c8-bddf-6c5b5f64e825 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:18.416663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da9ef-7a98-45c8-bddf-6c5b5f64e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:18.533741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f80da9ef-7a98-45c8-bddf-6c5b5f64e825 None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:18.535094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f80da9ef-7a98-45c8-bddf-6c5b5f64e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:18.560386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:18.626014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 658/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 14 02:43:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:18.635252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02768161-c630-4240-aef8-aca9ec92cc19 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:18.637090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-02768161-c630-4240-aef8-aca9ec92cc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:18.766208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02768161-c630-4240-aef8-aca9ec92cc19 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:18.850834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:18.851478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:18.851759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:18.852179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:18.853775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:18.925733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:18.990774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:18.992525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb32ab-fe19-4ed1-b8dd-097f668dbad6 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:19.017863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 653/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:21.509992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84286d4c-ead6-48b6-a39a-94e657535457 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:21.510582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84286d4c-ead6-48b6-a39a-94e657535457 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:21.510582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84286d4c-ead6-48b6-a39a-94e657535457 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:21.512146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 659/1312] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:21.517748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1ab4-39fd-4c89-9cf8-bde41f5e20c4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:21.518163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1ab4-39fd-4c89-9cf8-bde41f5e20c4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:21.518298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1ab4-39fd-4c89-9cf8-bde41f5e20c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:21.589910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e29b1ab4-39fd-4c89-9cf8-bde41f5e20c4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:21.591336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e29b1ab4-39fd-4c89-9cf8-bde41f5e20c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:21.686761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 654/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:21.971194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84286d4c-ead6-48b6-a39a-94e657535457 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:21.972743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-84286d4c-ead6-48b6-a39a-94e657535457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:22.079487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84286d4c-ead6-48b6-a39a-94e657535457 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:22.151932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:22.154802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:22.155411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:22.155693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:22.155964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:22.157550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:22.265537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:22.266940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83e875-619c-4fdd-b3b8-e666eff9c790 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:22.284795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 660/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:24.906116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e2a9-ba8d-4ef4-8fcb-0ba4ead918b7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:24.906677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e2a9-ba8d-4ef4-8fcb-0ba4ead918b7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:24.906677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e2a9-ba8d-4ef4-8fcb-0ba4ead918b7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:24.908032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 655/1315] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:24.913225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965197d-0804-4fff-b0bb-acd8c5bc42cf None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:24.913648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965197d-0804-4fff-b0bb-acd8c5bc42cf None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:24.913757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965197d-0804-4fff-b0bb-acd8c5bc42cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:24.979270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7965197d-0804-4fff-b0bb-acd8c5bc42cf None None] MFA Rules not processed for user `aab64679c18c462da84c42e8980f7579`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:24.980463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7965197d-0804-4fff-b0bb-acd8c5bc42cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:25.035767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:25.081146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 661/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:25.371396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e2a9-ba8d-4ef4-8fcb-0ba4ead918b7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:25.372995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-51b0e2a9-ba8d-4ef4-8fcb-0ba4ead918b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:25.382523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:25.476028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e2a9-ba8d-4ef4-8fcb-0ba4ead918b7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:25.547541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:25.548137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:25.548414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:25.548682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:25.550260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:25.616116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:25.662327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:25.663774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83d08d-a16b-4005-974c-f9e744c81bc2 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:25.681886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 656/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:28.581541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c0f5-723c-42a2-8a04-18eacc3e5ea9 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:28.582109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c0f5-723c-42a2-8a04-18eacc3e5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:28.582109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c0f5-723c-42a2-8a04-18eacc3e5ea9 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:28.583455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 662/1318] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:28.588560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa292aaf-8bcb-447b-bc80-ede1a24128ad None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:28.588976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa292aaf-8bcb-447b-bc80-ede1a24128ad None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:28.589116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa292aaf-8bcb-447b-bc80-ede1a24128ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:28.656547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-fa292aaf-8bcb-447b-bc80-ede1a24128ad None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:28.657741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fa292aaf-8bcb-447b-bc80-ede1a24128ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:28.757052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 657/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:29.060012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c0f5-723c-42a2-8a04-18eacc3e5ea9 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:29.061590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3c00c0f5-723c-42a2-8a04-18eacc3e5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:29.168548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00c0f5-723c-42a2-8a04-18eacc3e5ea9 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:29.241957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:29.242586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:29.242863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:29.243131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:29.244683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:29.251928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:29.353079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:29.354501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f19615-34a8-4f09-8307-ea5b19cdeef4 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:29.373508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 663/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:32.438380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07700ea-0e2a-4c9b-a552-6cefd1c76e79 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:32.438940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07700ea-0e2a-4c9b-a552-6cefd1c76e79 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:32.438940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07700ea-0e2a-4c9b-a552-6cefd1c76e79 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:32.440348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 658/1321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:32.445690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0ff3-0bd5-40f3-a965-e1266582b208 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:32.446095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0ff3-0bd5-40f3-a965-e1266582b208 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:32.446456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0ff3-0bd5-40f3-a965-e1266582b208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:32.513811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-22eb0ff3-0bd5-40f3-a965-e1266582b208 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:32.515264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-22eb0ff3-0bd5-40f3-a965-e1266582b208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:32.576219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:32.621523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 664/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:43:32.913672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07700ea-0e2a-4c9b-a552-6cefd1c76e79 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:32.915309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e07700ea-0e2a-4c9b-a552-6cefd1c76e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:32.936417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:33.021189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07700ea-0e2a-4c9b-a552-6cefd1c76e79 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:33.099609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:33.100858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:33.100858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:33.100858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:33.102274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:33.173409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:33.211453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:33.212883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69c1ca-c1ba-4638-9a8d-a67269a74ec5 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:33.231080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 659/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:35.481505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705034a-392c-4ba0-b0c6-ed9745a6425c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:35.482049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705034a-392c-4ba0-b0c6-ed9745a6425c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:35.482049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705034a-392c-4ba0-b0c6-ed9745a6425c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:35.483588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 665/1324] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:35.489518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf230c5-2500-4182-af50-ed956fb28731 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:35.490053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf230c5-2500-4182-af50-ed956fb28731 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:35.490053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf230c5-2500-4182-af50-ed956fb28731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:35.557141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-adf230c5-2500-4182-af50-ed956fb28731 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:35.558355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-adf230c5-2500-4182-af50-ed956fb28731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:35.659346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 660/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:35.949209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705034a-392c-4ba0-b0c6-ed9745a6425c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:35.950804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9705034a-392c-4ba0-b0c6-ed9745a6425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:36.058046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705034a-392c-4ba0-b0c6-ed9745a6425c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:36.137356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:36.138073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:36.138350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:36.138649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:36.140742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:36.159705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:36.254164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:36.255569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b96bc3-e414-4cf3-9898-56a5c2ace16a service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:36.275221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 666/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:38.495071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd549-580b-4761-af13-692b618f34f8 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:38.495583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd549-580b-4761-af13-692b618f34f8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:38.495706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd549-580b-4761-af13-692b618f34f8 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:38.496976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 661/1327] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:38.502171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7542248-1fae-4340-8548-d75eed1c588d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:38.502642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7542248-1fae-4340-8548-d75eed1c588d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:38.502810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7542248-1fae-4340-8548-d75eed1c588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:38.570006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d7542248-1fae-4340-8548-d75eed1c588d None None] MFA Rules not processed for user `aab64679c18c462da84c42e8980f7579`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:38.571233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d7542248-1fae-4340-8548-d75eed1c588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:38.636044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:38.668304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 667/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:38.966886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6453-dacc-4714-91db-bc57d7fd70ad None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:38.967211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6453-dacc-4714-91db-bc57d7fd70ad None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:38.967506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6453-dacc-4714-91db-bc57d7fd70ad None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:38.968907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 662/1329] 10.222.0.27 () {54 vars in 965 bytes} [Wed Sep 14 02:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:38.975153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8cd5f-2d98-4e30-9ee1-c5489d53535c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:38.975443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8cd5f-2d98-4e30-9ee1-c5489d53535c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:38.975720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8cd5f-2d98-4e30-9ee1-c5489d53535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:39.057851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-41e8cd5f-2d98-4e30-9ee1-c5489d53535c None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:39.059124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-41e8cd5f-2d98-4e30-9ee1-c5489d53535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:39.140002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 668/1330] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Sep 14 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:39.149032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6453-dacc-4714-91db-bc57d7fd70ad None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:39.150759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bcfa6453-dacc-4714-91db-bc57d7fd70ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:39.181447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:39.253374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6453-dacc-4714-91db-bc57d7fd70ad None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:39.327098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:39.327736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:39.328010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:39.328270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:39.329834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:39.409643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:39.450254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:39.452407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a30736-23b2-4950-9054-fbe77dcce80b service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:39.471066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 663/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:42.530880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62c582-8e43-4f09-864c-cfb2d2656a01 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:42.531472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62c582-8e43-4f09-864c-cfb2d2656a01 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:42.531472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62c582-8e43-4f09-864c-cfb2d2656a01 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:42.532822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 669/1332] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:42.537892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16578407-9752-4746-bf18-ce8b865c483b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:42.538304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16578407-9752-4746-bf18-ce8b865c483b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:42.538439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16578407-9752-4746-bf18-ce8b865c483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:42.611290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-16578407-9752-4746-bf18-ce8b865c483b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:42.612505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-16578407-9752-4746-bf18-ce8b865c483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:42.716684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 664/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:43.005004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62c582-8e43-4f09-864c-cfb2d2656a01 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:43.006575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fd62c582-8e43-4f09-864c-cfb2d2656a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:43.077143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:43.111520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62c582-8e43-4f09-864c-cfb2d2656a01 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:43.184097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:43.184707 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:43.184987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:43.185258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:43.186960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:43.313307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:43.314688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115b86-6c9e-4321-8be0-63f7110feb81 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:43.324490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:43.332413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 670/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:45.531194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b5811-2240-49fa-9864-80b6375b5e51 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:45.531765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b5811-2240-49fa-9864-80b6375b5e51 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:45.531765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b5811-2240-49fa-9864-80b6375b5e51 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:45.533100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 665/1335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:45.538314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6892a6-029e-4560-9815-d75b6358fab3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:45.538752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6892a6-029e-4560-9815-d75b6358fab3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:45.538906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6892a6-029e-4560-9815-d75b6358fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:45.604195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8f6892a6-029e-4560-9815-d75b6358fab3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:45.605402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8f6892a6-029e-4560-9815-d75b6358fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:45.700509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 671/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:45.987409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b5811-2240-49fa-9864-80b6375b5e51 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:45.988960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-423b5811-2240-49fa-9864-80b6375b5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:46.030384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:46.093703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b5811-2240-49fa-9864-80b6375b5e51 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:46.165537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:46.166133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:46.166426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:46.166711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:46.168286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:46.250381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:46.275483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:46.276896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e2421-f8f7-47b1-b726-c5e0c9ada39b service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:46.294912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 666/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:49.261048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d275e-721e-4aac-8214-214b714ef825 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:49.261570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d275e-721e-4aac-8214-214b714ef825 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:49.261665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d275e-721e-4aac-8214-214b714ef825 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:49.262999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 672/1338] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:49.269385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e691-b1ec-4634-904a-ccbf5ab4bd47 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:49.269816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e691-b1ec-4634-904a-ccbf5ab4bd47 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:49.269913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e691-b1ec-4634-904a-ccbf5ab4bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:49.334517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c007e691-b1ec-4634-904a-ccbf5ab4bd47 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:49.335696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c007e691-b1ec-4634-904a-ccbf5ab4bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:49.430416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 667/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:43:49.712690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d275e-721e-4aac-8214-214b714ef825 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:49.714224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6e4d275e-721e-4aac-8214-214b714ef825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:49.792131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:49.819646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d275e-721e-4aac-8214-214b714ef825 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:49.897264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:49.897870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:49.898146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:49.898420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:49.900297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:50.007784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:50.009130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db9507-5fba-4f2b-8e5c-6b62a214f1b2 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:50.027350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 673/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:54.464675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5b84e-6abd-4132-8c14-e6ab42e8250b None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:54.465263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5b84e-6abd-4132-8c14-e6ab42e8250b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:54.465263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5b84e-6abd-4132-8c14-e6ab42e8250b None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:54.467378 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 668/1341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:54.472608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f307b8-26d7-4a2b-bbf3-0d6a70fe84cc None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:54.474194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f307b8-26d7-4a2b-bbf3-0d6a70fe84cc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:54.474194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f307b8-26d7-4a2b-bbf3-0d6a70fe84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:54.479387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:54.544265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d2f307b8-26d7-4a2b-bbf3-0d6a70fe84cc None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:54.546262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d2f307b8-26d7-4a2b-bbf3-0d6a70fe84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:54.642442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 674/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:54.937435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5b84e-6abd-4132-8c14-e6ab42e8250b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:54.940255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9bc5b84e-6abd-4132-8c14-e6ab42e8250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:54.999231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:55.057745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5b84e-6abd-4132-8c14-e6ab42e8250b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:55.153873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:55.155128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:55.155506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:55.155777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:55.157404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:55.277099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:55.297773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:55.300040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615755bf-21e0-424b-92d3-3604b4d4906e service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:55.323221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 669/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:43:58.648093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ca41-6f1d-41d0-b445-5b01a3698278 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:58.648639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ca41-6f1d-41d0-b445-5b01a3698278 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:58.648639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ca41-6f1d-41d0-b445-5b01a3698278 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:58.650366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 675/1344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:43:58.655793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205059f8-b03e-441e-970d-6380052a0344 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:58.656288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205059f8-b03e-441e-970d-6380052a0344 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:58.656381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205059f8-b03e-441e-970d-6380052a0344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:58.731717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-205059f8-b03e-441e-970d-6380052a0344 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:43:58.732872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-205059f8-b03e-441e-970d-6380052a0344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:58.834459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 670/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:43:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:43:59.115796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ca41-6f1d-41d0-b445-5b01a3698278 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:43:59.117350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-43f2ca41-6f1d-41d0-b445-5b01a3698278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:59.224330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:43:59.241665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ca41-6f1d-41d0-b445-5b01a3698278 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:43:59.331371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:43:59.338151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:43:59.338151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:43:59.338151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:43:59.338151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:43:59.455739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:43:59.457157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d75344-437a-40b9-8c22-e5274d0120eb service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:43:59.478135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 676/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:04.019846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df138b-ce6f-409c-9d7b-dda0162c4dd8 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:04.020381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df138b-ce6f-409c-9d7b-dda0162c4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:04.020381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df138b-ce6f-409c-9d7b-dda0162c4dd8 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:04.021738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 671/1347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:04.027581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80420-c87c-4882-bedb-568c3e3bfabd None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:04.028091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80420-c87c-4882-bedb-568c3e3bfabd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:04.028267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80420-c87c-4882-bedb-568c3e3bfabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:04.045623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:04.100420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b0e80420-c87c-4882-bedb-568c3e3bfabd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:04.101632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0e80420-c87c-4882-bedb-568c3e3bfabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:04.202499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 677/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:04.484570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df138b-ce6f-409c-9d7b-dda0162c4dd8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:04.486091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c0df138b-ce6f-409c-9d7b-dda0162c4dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:04.545893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:04.591524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df138b-ce6f-409c-9d7b-dda0162c4dd8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:04.664408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:04.665012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:04.665290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:04.665561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:04.667178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:04.787445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:04.791088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:04.792633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44595e-6265-45c6-b883-3a5fad7febda service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:04.811613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 672/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:09.766786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba2b9-ba49-496b-96c1-feb59d7f6eb4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:09.767275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba2b9-ba49-496b-96c1-feb59d7f6eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:09.767356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dba2b9-ba49-496b-96c1-feb59d7f6eb4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:09.768680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 678/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:09.774009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6b59-c2bb-4e59-b8d8-780ffc41206a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:09.774416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6b59-c2bb-4e59-b8d8-780ffc41206a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:09.777144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6b59-c2bb-4e59-b8d8-780ffc41206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:09.893776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c6ae6b59-c2bb-4e59-b8d8-780ffc41206a None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:09.895083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c6ae6b59-c2bb-4e59-b8d8-780ffc41206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:10.054019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 673/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:44:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:14.201370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=59 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:14.215329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34073-2784-4a74-82c9-985d47760d9c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:14.217621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34073-2784-4a74-82c9-985d47760d9c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:14.217621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34073-2784-4a74-82c9-985d47760d9c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:14.218149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 679/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:14.223155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24e9b-1a4b-41e1-b88b-bb7b3d6b5e66 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:14.223615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24e9b-1a4b-41e1-b88b-bb7b3d6b5e66 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:14.223717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24e9b-1a4b-41e1-b88b-bb7b3d6b5e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:14.290052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:14.315620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3ad24e9b-1a4b-41e1-b88b-bb7b3d6b5e66 None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:14.316868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3ad24e9b-1a4b-41e1-b88b-bb7b3d6b5e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:14.445284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 674/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:44:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:15.940279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934317e0-3062-4ae5-8cb6-d67f2f696bab None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:15.940872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934317e0-3062-4ae5-8cb6-d67f2f696bab None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:15.940872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934317e0-3062-4ae5-8cb6-d67f2f696bab None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:15.942139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 680/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:15.947103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598e88-e009-4751-a578-1a3dc24f1dec None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:15.947548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598e88-e009-4751-a578-1a3dc24f1dec None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:15.947791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598e88-e009-4751-a578-1a3dc24f1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:16.026674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8c598e88-e009-4751-a578-1a3dc24f1dec None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:16.027891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8c598e88-e009-4751-a578-1a3dc24f1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:16.071000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:16.138738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 675/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:44:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:19.895841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f710-2e91-4b63-a605-cb0740742a5c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:19.897011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f710-2e91-4b63-a605-cb0740742a5c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:19.897737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f710-2e91-4b63-a605-cb0740742a5c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:19.899579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 681/1356] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:19.906371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a8c32-b0cc-42e9-b656-204a7f0fda31 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:19.906915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a8c32-b0cc-42e9-b656-204a7f0fda31 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:19.907042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a8c32-b0cc-42e9-b656-204a7f0fda31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:19.977026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-691a8c32-b0cc-42e9-b656-204a7f0fda31 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:19.978123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-691a8c32-b0cc-42e9-b656-204a7f0fda31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:20.094636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 676/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:20.392987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3cd6c-06d3-409f-a1ad-dca652ed878e None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:20.393640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3cd6c-06d3-409f-a1ad-dca652ed878e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:20.394175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3cd6c-06d3-409f-a1ad-dca652ed878e None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:20.396518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 682/1358] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 14 02:44:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:20.406433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a99be2-1275-419b-8fe7-24af1571a47c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:20.406752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a99be2-1275-419b-8fe7-24af1571a47c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:20.407027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a99be2-1275-419b-8fe7-24af1571a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:20.423414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:20.484558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e1a99be2-1275-419b-8fe7-24af1571a47c None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:20.485757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e1a99be2-1275-419b-8fe7-24af1571a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:20.604890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 677/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 14 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:20.613626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3cd6c-06d3-409f-a1ad-dca652ed878e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:20.615307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-34a3cd6c-06d3-409f-a1ad-dca652ed878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:20.771651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3cd6c-06d3-409f-a1ad-dca652ed878e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:20.902501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:20.913558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:20.914202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:20.914557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:20.914832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:20.916401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:21.019105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:21.020686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf3b50-1db7-442d-9071-6ffbe525a3c5 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:21.040362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 683/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:44:23.418964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6df3d9-843a-4875-b2b3-5005d77a22ef None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:23.420228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6df3d9-843a-4875-b2b3-5005d77a22ef None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:23.420228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6df3d9-843a-4875-b2b3-5005d77a22ef None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:23.421600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 678/1361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:23.426921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec093e47-7e3d-44fe-a57a-22b2b7cabc9f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:23.427718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec093e47-7e3d-44fe-a57a-22b2b7cabc9f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:23.427987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec093e47-7e3d-44fe-a57a-22b2b7cabc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:23.496549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ec093e47-7e3d-44fe-a57a-22b2b7cabc9f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:23.498092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ec093e47-7e3d-44fe-a57a-22b2b7cabc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:23.536079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:23.600753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 684/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:23.886503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6df3d9-843a-4875-b2b3-5005d77a22ef None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:23.888766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8c6df3d9-843a-4875-b2b3-5005d77a22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:23.961413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:24.054492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6df3d9-843a-4875-b2b3-5005d77a22ef None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:24.202677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:24.203285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:24.203564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:24.203831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:24.205399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:24.233010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:24.304209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:24.305884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24ea06-cc80-4fd8-a02a-417cc3587b1a service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:24.324370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 679/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:26.912505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5e6b-bb7e-48fb-a0b1-3b17b8d6f717 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:26.913074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5e6b-bb7e-48fb-a0b1-3b17b8d6f717 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:26.913074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5e6b-bb7e-48fb-a0b1-3b17b8d6f717 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:26.914381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 685/1364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:26.920286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1e939-2ac0-42b4-9772-ecd3c49c7141 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:26.920708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1e939-2ac0-42b4-9772-ecd3c49c7141 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:26.920824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1e939-2ac0-42b4-9772-ecd3c49c7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:26.994236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-bdd1e939-2ac0-42b4-9772-ecd3c49c7141 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:27.003626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bdd1e939-2ac0-42b4-9772-ecd3c49c7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:27.114764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:27.122514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 680/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:27.421941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cc083-a184-437c-9e9c-b96603c43255 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:27.422229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cc083-a184-437c-9e9c-b96603c43255 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:27.422537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cc083-a184-437c-9e9c-b96603c43255 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:27.424071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 686/1366] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 14 02:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:27.430380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1f07-5abf-4dc9-8a43-9e01587ad365 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:27.430723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1f07-5abf-4dc9-8a43-9e01587ad365 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:27.431005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1f07-5abf-4dc9-8a43-9e01587ad365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:27.529448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-380c1f07-5abf-4dc9-8a43-9e01587ad365 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:27.530926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-380c1f07-5abf-4dc9-8a43-9e01587ad365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:27.656131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 681/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 14 02:44:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:27.664987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cc083-a184-437c-9e9c-b96603c43255 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:27.666648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a02cc083-a184-437c-9e9c-b96603c43255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:27.833761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cc083-a184-437c-9e9c-b96603c43255 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:27.855502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:27.955085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:27.955855 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:27.956225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:27.956595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:27.958398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:28.057459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:28.059365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff32428-c7b6-4a55-875e-492d4ee75db6 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:28.083655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 687/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:44:28.141435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4407-bb0d-4d1f-8cc0-0efb5297c3c3 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:28.142008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4407-bb0d-4d1f-8cc0-0efb5297c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:28.142008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4407-bb0d-4d1f-8cc0-0efb5297c3c3 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:28.143369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 682/1369] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:28.148718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c147-30cc-4c00-b924-8cdd86ebb21a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:28.149003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c147-30cc-4c00-b924-8cdd86ebb21a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:28.149280 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2c147-30cc-4c00-b924-8cdd86ebb21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:28.182391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:28.226351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9ba2c147-30cc-4c00-b924-8cdd86ebb21a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:28.227263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9ba2c147-30cc-4c00-b924-8cdd86ebb21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:28.335235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 688/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:28.681896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816840-e1b3-4386-92c2-f499b17c5ca3 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:28.681896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816840-e1b3-4386-92c2-f499b17c5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:28.681896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e816840-e1b3-4386-92c2-f499b17c5ca3 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:28.681896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 683/1371] 10.222.0.27 () {54 vars in 964 bytes} [Wed Sep 14 02:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:44:28.687399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897140-d102-47f1-a0ee-8d817b73cc1a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:28.687689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897140-d102-47f1-a0ee-8d817b73cc1a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:28.687966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897140-d102-47f1-a0ee-8d817b73cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:28.769928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5c897140-d102-47f1-a0ee-8d817b73cc1a None None] MFA Rules not processed for user `d1aaf929efbc4f818d2f0b133d449f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:28.771207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5c897140-d102-47f1-a0ee-8d817b73cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:28.829166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:28.860689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 689/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Sep 14 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:28.868418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e816840-e1b3-4386-92c2-f499b17c5ca3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:28.869940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6e816840-e1b3-4386-92c2-f499b17c5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:28.926405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:28.992516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e816840-e1b3-4386-92c2-f499b17c5ca3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:29.083780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:29.084397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:29.084675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:29.084941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:29.086601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:29.209902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:29.229245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:29.231136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09ec4b-3c56-4d67-adad-c83aecc6c824 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:29.254883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 684/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:30.519706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eba8d-c420-4041-97d2-5db87b68018f None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:30.520260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eba8d-c420-4041-97d2-5db87b68018f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:30.520408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eba8d-c420-4041-97d2-5db87b68018f None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:30.521997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 690/1374] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:30.527548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c690a-abdc-4219-9782-05adaffabe28 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:30.527961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c690a-abdc-4219-9782-05adaffabe28 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:30.528083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c690a-abdc-4219-9782-05adaffabe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:30.595653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-438c690a-abdc-4219-9782-05adaffabe28 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:30.596877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-438c690a-abdc-4219-9782-05adaffabe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:30.695456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 685/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:31.005272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eba8d-c420-4041-97d2-5db87b68018f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:31.007016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a13eba8d-c420-4041-97d2-5db87b68018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:31.175648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eba8d-c420-4041-97d2-5db87b68018f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:31.229658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:31.296211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:31.296825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:31.297467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:31.297467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:31.299036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:31.394743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:31.396329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04790415-0789-4a1e-8770-7a192266d373 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:31.416006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 691/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:33.764210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ab0c-53e2-4261-96a3-3c22770eade3 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:33.764751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ab0c-53e2-4261-96a3-3c22770eade3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:33.764751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ab0c-53e2-4261-96a3-3c22770eade3 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:33.766192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 686/1377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:33.771531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a461-d208-4608-a5aa-dd0cf3d620f1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:33.771929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a461-d208-4608-a5aa-dd0cf3d620f1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:33.772121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a461-d208-4608-a5aa-dd0cf3d620f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:33.840307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-fef6a461-d208-4608-a5aa-dd0cf3d620f1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:33.841691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fef6a461-d208-4608-a5aa-dd0cf3d620f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:33.848890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:33.943355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 692/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:34.240031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ab0c-53e2-4261-96a3-3c22770eade3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:34.241621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2c87ab0c-53e2-4261-96a3-3c22770eade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:34.305390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:34.391995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ab0c-53e2-4261-96a3-3c22770eade3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:34.513725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:34.514356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:34.514680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:34.514951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:34.516509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:34.536690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:34.612266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:34.613987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4108-35d9-46a0-b683-a21cfa769851 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:34.633888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 687/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:37.024995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6288-5a12-4dc0-8ff7-c920328a843a None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:37.025676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6288-5a12-4dc0-8ff7-c920328a843a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:37.025942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6288-5a12-4dc0-8ff7-c920328a843a None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:37.030922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 693/1380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:37.038936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0859-2a04-4f0b-bb00-2a966ddf3818 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:37.039372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0859-2a04-4f0b-bb00-2a966ddf3818 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:37.040060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0859-2a04-4f0b-bb00-2a966ddf3818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:37.119539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-53cf0859-2a04-4f0b-bb00-2a966ddf3818 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:37.120846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-53cf0859-2a04-4f0b-bb00-2a966ddf3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:37.224034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:37.229700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 688/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:37.609687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6288-5a12-4dc0-8ff7-c920328a843a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:37.611292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bb8f6288-5a12-4dc0-8ff7-c920328a843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:37.754755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:37.765666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6288-5a12-4dc0-8ff7-c920328a843a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:37.900802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:37.901335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:37.901624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:37.901890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:37.903528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:37.994823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:37.996836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae329270-d6b6-412c-8fad-322086f7c15c service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:38.007864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:38.017004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 694/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:40.930425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47e202-6f5f-48ee-b301-1443d27859c7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:40.931008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47e202-6f5f-48ee-b301-1443d27859c7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:40.931132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47e202-6f5f-48ee-b301-1443d27859c7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:40.932579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 689/1383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:40.938310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6eadb-2e62-4d1f-938d-15f1e61b5dab None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:40.938769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6eadb-2e62-4d1f-938d-15f1e61b5dab None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:40.938891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6eadb-2e62-4d1f-938d-15f1e61b5dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:41.011524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-35a6eadb-2e62-4d1f-938d-15f1e61b5dab None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:41.012853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-35a6eadb-2e62-4d1f-938d-15f1e61b5dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:41.132705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 695/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:41.567463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47e202-6f5f-48ee-b301-1443d27859c7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:41.569042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0b47e202-6f5f-48ee-b301-1443d27859c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:41.722711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47e202-6f5f-48ee-b301-1443d27859c7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:41.801899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:41.853449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:41.854063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:41.854374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:41.854674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:41.856392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:41.949632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:41.951889 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affde70b-c75e-4b21-a2ce-0af111ecda20 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:41.971007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 690/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:44:44.139016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055991fd-d08e-4923-851c-78b9ca66ecc4 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:44.139517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055991fd-d08e-4923-851c-78b9ca66ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:44.139623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055991fd-d08e-4923-851c-78b9ca66ecc4 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:44.140905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 696/1386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:44.146312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d653d-c4ff-4fc3-a595-91ddcc9d315e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:44.146749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d653d-c4ff-4fc3-a595-91ddcc9d315e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:44.146918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d653d-c4ff-4fc3-a595-91ddcc9d315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:44.215587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d30d653d-c4ff-4fc3-a595-91ddcc9d315e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:44.217428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d30d653d-c4ff-4fc3-a595-91ddcc9d315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:44.249830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:44.312982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 691/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:44.600836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055991fd-d08e-4923-851c-78b9ca66ecc4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:44.602388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-055991fd-d08e-4923-851c-78b9ca66ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:44.680551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:44.751306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055991fd-d08e-4923-851c-78b9ca66ecc4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:44.872722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:44.873693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:44.873983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:44.874259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:44.875888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:44.880417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deecd10-9384-4561-a115-705792fb76d9 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:44.880705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deecd10-9384-4561-a115-705792fb76d9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:44.880981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deecd10-9384-4561-a115-705792fb76d9 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:44.882503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 692/1388] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:44.887420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293fec6-5560-4750-850c-541a87b7cdc4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:44.888295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293fec6-5560-4750-850c-541a87b7cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:44.888579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293fec6-5560-4750-850c-541a87b7cdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:44.917507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:44.958344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5293fec6-5560-4750-850c-541a87b7cdc4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:44.959491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5293fec6-5560-4750-850c-541a87b7cdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:44.971854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:44.973583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1299fa9-99af-4f96-8b6d-dfaf9d248d2d service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:44.992126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 697/1389] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:45.059096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 693/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:45.379042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175722-f9c0-495f-bc2f-0f5a8a418eb3 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:45.379493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175722-f9c0-495f-bc2f-0f5a8a418eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:45.379748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175722-f9c0-495f-bc2f-0f5a8a418eb3 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:45.381215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 698/1391] 10.222.0.27 () {54 vars in 966 bytes} [Wed Sep 14 02:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:45.386682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0d9ed-bd92-443e-aff4-51f015ce4d8d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:45.387087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0d9ed-bd92-443e-aff4-51f015ce4d8d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:45.387230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0d9ed-bd92-443e-aff4-51f015ce4d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:45.404757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:45.467689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-66e0d9ed-bd92-443e-aff4-51f015ce4d8d None None] MFA Rules not processed for user `27f39b9d908644379d12e3e0b4fc4635`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:45.468879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-66e0d9ed-bd92-443e-aff4-51f015ce4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:45.546455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 694/1392] 10.222.0.27 () {58 vars in 1063 bytes} [Wed Sep 14 02:44:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:45.557720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175722-f9c0-495f-bc2f-0f5a8a418eb3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:45.559319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-87175722-f9c0-495f-bc2f-0f5a8a418eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:45.671659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175722-f9c0-495f-bc2f-0f5a8a418eb3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:45.732907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:45.748211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:45.749055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:45.749339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:45.749608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:45.751229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:45.877555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:45.878931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb111e0-36f6-4d45-932e-7823de45b063 service glance] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:45.897789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 699/1393] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:46.815915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7d72c-6397-46b0-8fe6-9fc74bcc5b79 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:46.816451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7d72c-6397-46b0-8fe6-9fc74bcc5b79 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:46.816543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7d72c-6397-46b0-8fe6-9fc74bcc5b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:46.885189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-cef7d72c-6397-46b0-8fe6-9fc74bcc5b79 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:46.886428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-cef7d72c-6397-46b0-8fe6-9fc74bcc5b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:46.942444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:46.975951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 695/1394] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:44:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:47.024119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edbf2-7d5c-40d2-ba67-bf01fde02b3b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:47.024584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edbf2-7d5c-40d2-ba67-bf01fde02b3b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:47.024921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edbf2-7d5c-40d2-ba67-bf01fde02b3b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:47.026617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 700/1395] 10.222.0.27 () {54 vars in 943 bytes} [Wed Sep 14 02:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:47.033672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a480c-126a-4647-be71-02f25e28cdc2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:47.034773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a480c-126a-4647-be71-02f25e28cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:47.034773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a480c-126a-4647-be71-02f25e28cdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:47.122151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-102a480c-126a-4647-be71-02f25e28cdc2 None None] MFA Rules not processed for user `476b4c55503a4c01b0ad7882e62f5461`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:47.123417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-102a480c-126a-4647-be71-02f25e28cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:47.239326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 696/1396] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Sep 14 02:44:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:47.249140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0edbf2-7d5c-40d2-ba67-bf01fde02b3b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:47.250691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ca0edbf2-7d5c-40d2-ba67-bf01fde02b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:47.322293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580ce1-ed80-440b-88e5-f6598ced2bac None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:47.322615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580ce1-ed80-440b-88e5-f6598ced2bac None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:47.322900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580ce1-ed80-440b-88e5-f6598ced2bac None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:47.324249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 697/1397] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:44:47.329495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:47.329779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:47.330051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:47.346616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:47.367132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:47.395749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0edbf2-7d5c-40d2-ba67-bf01fde02b3b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:47.398248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:47.399500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:47.501978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:47.502484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 698/1398] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:47.506604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:47.506604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:47.506604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:47.506604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:47.578148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:47.590079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:47.592066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563edd9-9ca8-455c-9cf9-2c1e6e88613b service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:47.600834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 701/1399] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:44:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:44:47.789679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:47.790903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:47.905105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:47.909144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4adb3-f320-473d-8c7d-ccb3174070b2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:48.057429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:48.057964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:48.058241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:48.058533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:48.060268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:48.169890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:48.171537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bca5a0-c5a5-4cd1-a42e-cd29a338c08a service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:48.193359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 699/1400] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:50.513893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8fbe-32ed-4545-a65c-2a393993ca26 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:50.514772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8fbe-32ed-4545-a65c-2a393993ca26 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:50.514772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8fbe-32ed-4545-a65c-2a393993ca26 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:50.519898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 702/1401] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:50.521473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24c50-f153-4d63-a64f-b8a97eb3b878 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:50.521893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24c50-f153-4d63-a64f-b8a97eb3b878 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:50.522068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24c50-f153-4d63-a64f-b8a97eb3b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:50.526801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:50.595434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9db24c50-f153-4d63-a64f-b8a97eb3b878 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:50.596655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9db24c50-f153-4d63-a64f-b8a97eb3b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:50.706721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 700/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:50.994350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8fbe-32ed-4545-a65c-2a393993ca26 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:50.995906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-701e8fbe-32ed-4545-a65c-2a393993ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:51.184426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8fbe-32ed-4545-a65c-2a393993ca26 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:51.257863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:51.313961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:51.314607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:51.314896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:51.315156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:51.318069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:51.430064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:51.431771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b27cf-3e80-442a-8bf5-0f2e1d07be50 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:51.451450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 703/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:54.341486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d5ae-86ba-4cc3-8bc1-63441083daff None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:54.342065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d5ae-86ba-4cc3-8bc1-63441083daff None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:54.342065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d5ae-86ba-4cc3-8bc1-63441083daff None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:54.343305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 701/1404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:54.348534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102151a7-5424-4342-871a-e70ba6301bd2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:54.348947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102151a7-5424-4342-871a-e70ba6301bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:54.349079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102151a7-5424-4342-871a-e70ba6301bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:54.422638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-102151a7-5424-4342-871a-e70ba6301bd2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:54.423899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-102151a7-5424-4342-871a-e70ba6301bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:54.453183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:54.531092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 704/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:44:54.821372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d5ae-86ba-4cc3-8bc1-63441083daff None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:54.823182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4864d5ae-86ba-4cc3-8bc1-63441083daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:54.914698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:54.983214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d5ae-86ba-4cc3-8bc1-63441083daff None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:55.124687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:55.125305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:55.125579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:55.125854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:55.127500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:55.179657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:55.234822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:55.236500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdc9ec-6986-473c-87cb-83c35bd759a7 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:55.256090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 702/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:44:57.724927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970194-b838-4c09-ae42-68eb017fe96a None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:57.725441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970194-b838-4c09-ae42-68eb017fe96a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:57.725441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970194-b838-4c09-ae42-68eb017fe96a None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:57.726822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 705/1407] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:44:57.732298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae65b1d-5f77-4060-a63f-256a8e7b565b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:57.732735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae65b1d-5f77-4060-a63f-256a8e7b565b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:57.732886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae65b1d-5f77-4060-a63f-256a8e7b565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:57.806022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-bae65b1d-5f77-4060-a63f-256a8e7b565b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:44:57.807367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bae65b1d-5f77-4060-a63f-256a8e7b565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:57.923943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 703/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:44:58.225870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970194-b838-4c09-ae42-68eb017fe96a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:44:58.227583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-50970194-b838-4c09-ae42-68eb017fe96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:58.409014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970194-b838-4c09-ae42-68eb017fe96a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:44:58.418477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:44:58.531678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:44:58.532293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:44:58.532587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:44:58.532843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:44:58.534507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:44:58.644965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:44:58.646681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505e0c2-dbb3-4d38-8bf7-543e725de7f8 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:44:58.669551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 706/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:07.921987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:08.666233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=94 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:11.485466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a26244-1554-45ac-a015-8b388c01eab1 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:11.485934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a26244-1554-45ac-a015-8b388c01eab1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:11.486045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a26244-1554-45ac-a015-8b388c01eab1 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:11.487403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 704/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 14 02:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:11.492493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20c50-6677-4435-ac36-49e82284d8bb None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:11.492938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20c50-6677-4435-ac36-49e82284d8bb None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:11.493041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20c50-6677-4435-ac36-49e82284d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:11.572284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5af20c50-6677-4435-ac36-49e82284d8bb None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:11.573532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5af20c50-6677-4435-ac36-49e82284d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:11.680817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 707/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 14 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:11.695107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aae3a-d220-49b4-90b7-f389f1756fcf None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:11.695394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aae3a-d220-49b4-90b7-f389f1756fcf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:11.695671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aae3a-d220-49b4-90b7-f389f1756fcf None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:11.697034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 705/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Sep 14 02:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:11.702007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dc71d-da67-4abe-ab72-50888a935e59 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:11.702326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dc71d-da67-4abe-ab72-50888a935e59 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:11.702650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dc71d-da67-4abe-ab72-50888a935e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:11.776826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:11.781063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a15dc71d-da67-4abe-ab72-50888a935e59 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:11.782265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a15dc71d-da67-4abe-ab72-50888a935e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:11.895940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 708/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Sep 14 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:14.493744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093665-cfab-40ac-aec3-1b5ba6102316 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:14.494291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093665-cfab-40ac-aec3-1b5ba6102316 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:14.494291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1093665-cfab-40ac-aec3-1b5ba6102316 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:14.495646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:14.501587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48774d54-9371-4b8d-8c21-0d737834e5f2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:14.502008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48774d54-9371-4b8d-8c21-0d737834e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:14.502137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48774d54-9371-4b8d-8c21-0d737834e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:14.579756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-48774d54-9371-4b8d-8c21-0d737834e5f2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:14.580979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-48774d54-9371-4b8d-8c21-0d737834e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:14.634760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:14.675820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:14.975342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1093665-cfab-40ac-aec3-1b5ba6102316 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:14.976869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b1093665-cfab-40ac-aec3-1b5ba6102316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:15.122125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1093665-cfab-40ac-aec3-1b5ba6102316 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:15.192776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:15.231807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:15.232336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:15.232610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:15.232903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:15.234482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:15.331329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:15.332905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f80776-15c1-4d4f-b3f9-d9bdb01b328d service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:15.350877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 707/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:16.519221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1bc3-f0b0-4672-930c-78e735bf1a71 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:16.519812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1bc3-f0b0-4672-930c-78e735bf1a71 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:16.520149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1bc3-f0b0-4672-930c-78e735bf1a71 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:16.522369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:16.530140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e302-5af1-49dd-b3d5-3258e9f23bb0 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:16.530705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e302-5af1-49dd-b3d5-3258e9f23bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:16.530705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e302-5af1-49dd-b3d5-3258e9f23bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:16.608729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5341e302-5af1-49dd-b3d5-3258e9f23bb0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:16.609929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5341e302-5af1-49dd-b3d5-3258e9f23bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:16.638459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:16.708621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:45:16.861050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1bc3-f0b0-4672-930c-78e735bf1a71 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:16.862533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c8bb1bc3-f0b0-4672-930c-78e735bf1a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:17.011324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1bc3-f0b0-4672-930c-78e735bf1a71 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:17.053095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:17.126990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:17.127516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:17.127793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:17.128063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:17.129655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:17.231440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:17.233093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ef399-4566-4a58-8153-07b8dc4a9d02 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:17.250684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 711/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:18.382035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edd410-d523-4135-879c-6f7e9a742f99 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:18.382560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edd410-d523-4135-879c-6f7e9a742f99 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:18.382560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edd410-d523-4135-879c-6f7e9a742f99 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:18.383870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:18.390166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608720-8b18-407f-bcbc-1758fe7f290b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:18.390621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608720-8b18-407f-bcbc-1758fe7f290b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:18.390742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608720-8b18-407f-bcbc-1758fe7f290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:18.444061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:18.466537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3c608720-8b18-407f-bcbc-1758fe7f290b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:18.467743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3c608720-8b18-407f-bcbc-1758fe7f290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:18.565008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:45:18.724536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edd410-d523-4135-879c-6f7e9a742f99 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:18.726062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e5edd410-d523-4135-879c-6f7e9a742f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:18.870268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edd410-d523-4135-879c-6f7e9a742f99 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:18.882747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:18.982391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:18.982941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:18.983214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:18.983482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:18.985057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:19.073281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:19.074912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443f5f0-71f1-4c70-aa28-297a8c9b35a8 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:19.097857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 710/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:20.223679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4138df-0ed4-4d7a-b777-609bcde82763 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:20.224234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4138df-0ed4-4d7a-b777-609bcde82763 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:20.224234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4138df-0ed4-4d7a-b777-609bcde82763 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:20.225606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:20.232781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a6bf-71ef-4b93-97e5-18249dd3d920 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:20.233237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a6bf-71ef-4b93-97e5-18249dd3d920 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:20.233349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8a6bf-71ef-4b93-97e5-18249dd3d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:20.253710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:20.310299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4de8a6bf-71ef-4b93-97e5-18249dd3d920 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:20.311611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4de8a6bf-71ef-4b93-97e5-18249dd3d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:20.406153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:20.556218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4138df-0ed4-4d7a-b777-609bcde82763 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:20.557723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ef4138df-0ed4-4d7a-b777-609bcde82763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:20.666401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:20.701650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4138df-0ed4-4d7a-b777-609bcde82763 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:20.816191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:20.816798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:20.817078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:20.817348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:20.818958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:20.894948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:20.909379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:20.911085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f052fe-67ab-4c45-bda7-07daaa6a22a2 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:20.929237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 714/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:22.058343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28099ae-e02b-4a76-b856-bd2cd4a61795 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:22.058947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28099ae-e02b-4a76-b856-bd2cd4a61795 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:22.058947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28099ae-e02b-4a76-b856-bd2cd4a61795 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:22.060938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:22.067495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a472-8730-4db5-ba07-4639dac5d650 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:22.067943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a472-8730-4db5-ba07-4639dac5d650 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:22.068085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a472-8730-4db5-ba07-4639dac5d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:22.145072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0e27a472-8730-4db5-ba07-4639dac5d650 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:22.146301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0e27a472-8730-4db5-ba07-4639dac5d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:22.242005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:22.390816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28099ae-e02b-4a76-b856-bd2cd4a61795 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:22.392226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a28099ae-e02b-4a76-b856-bd2cd4a61795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:22.475057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:22.535427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28099ae-e02b-4a76-b856-bd2cd4a61795 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:22.647271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:22.647795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:22.648074 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:22.648344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:22.649928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:22.699730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:22.740245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:22.741825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410a5a9-f6d1-4052-84d3-8f2ade632e2d service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:22.759992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 713/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:23.888850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036bf7-49d3-4ccd-899d-4dcdf531509d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:23.889409 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036bf7-49d3-4ccd-899d-4dcdf531509d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:23.889409 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036bf7-49d3-4ccd-899d-4dcdf531509d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:23.890698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:23.896822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799efd7b-2dbe-499e-86ed-1803b5cbf965 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:23.897348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799efd7b-2dbe-499e-86ed-1803b5cbf965 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:23.897454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799efd7b-2dbe-499e-86ed-1803b5cbf965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:23.974452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-799efd7b-2dbe-499e-86ed-1803b5cbf965 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:23.975679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-799efd7b-2dbe-499e-86ed-1803b5cbf965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:24.071513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:24.222330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036bf7-49d3-4ccd-899d-4dcdf531509d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:24.223865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-58036bf7-49d3-4ccd-899d-4dcdf531509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:24.272659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:24.369492 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036bf7-49d3-4ccd-899d-4dcdf531509d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:24.483362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:24.483891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:24.484168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:24.484442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:24.486022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:24.492860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:24.574839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:24.577041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d00792-dcd1-488a-9bba-020ebba8f723 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:24.594954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 717/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:25.701973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa4283-e671-421f-ab63-204528b54fa6 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:25.702583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa4283-e671-421f-ab63-204528b54fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:25.702583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa4283-e671-421f-ab63-204528b54fa6 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:25.703918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:45:25.710284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5a58-6d8e-43d5-9942-e15d02a625e2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:25.710767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5a58-6d8e-43d5-9942-e15d02a625e2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:25.710871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5a58-6d8e-43d5-9942-e15d02a625e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:25.787438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1a6a5a58-6d8e-43d5-9942-e15d02a625e2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:25.788534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1a6a5a58-6d8e-43d5-9942-e15d02a625e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:25.855881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:25.885268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:45:26.038055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa4283-e671-421f-ab63-204528b54fa6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:26.039590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a6aa4283-e671-421f-ab63-204528b54fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:26.057643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:26.185605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa4283-e671-421f-ab63-204528b54fa6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:26.278964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:26.305854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:26.306387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:26.306694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:26.306990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:26.309221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:26.397402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:26.399036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e0838-b2b5-43f3-b090-cca5b46424a0 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:26.416858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 716/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:27.541618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f524e9-7f78-45fc-bb96-f08c108cc40d None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:27.542149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f524e9-7f78-45fc-bb96-f08c108cc40d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:27.542149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f524e9-7f78-45fc-bb96-f08c108cc40d None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:27.543546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:27.550322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e30c4-6944-41b7-a91b-e13b8da0edc8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:27.550822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e30c4-6944-41b7-a91b-e13b8da0edc8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:27.550926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e30c4-6944-41b7-a91b-e13b8da0edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:27.627415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-eb5e30c4-6944-41b7-a91b-e13b8da0edc8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:27.628606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-eb5e30c4-6944-41b7-a91b-e13b8da0edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:27.669756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:27.724142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:27.874432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f524e9-7f78-45fc-bb96-f08c108cc40d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:27.875961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-31f524e9-7f78-45fc-bb96-f08c108cc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:28.021918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f524e9-7f78-45fc-bb96-f08c108cc40d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:28.075619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:28.135639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:28.136243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:28.136518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:28.136783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:28.138349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:28.226434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:28.228073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4848d5d-e488-41b4-bcac-38e85da952d0 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:28.245691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 720/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:29.347426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859980-76bb-431e-8bd5-6d7d2107240d None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:29.347968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859980-76bb-431e-8bd5-6d7d2107240d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:29.347968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859980-76bb-431e-8bd5-6d7d2107240d None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:29.349225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:29.355655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193550f-9229-4548-96ed-6c78a0620bda None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:29.356064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193550f-9229-4548-96ed-6c78a0620bda None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:29.356207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193550f-9229-4548-96ed-6c78a0620bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:29.431046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2193550f-9229-4548-96ed-6c78a0620bda None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:29.432256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2193550f-9229-4548-96ed-6c78a0620bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:29.434222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:29.534511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:29.685038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859980-76bb-431e-8bd5-6d7d2107240d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:29.687122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a0859980-76bb-431e-8bd5-6d7d2107240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:29.838383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859980-76bb-431e-8bd5-6d7d2107240d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:29.867630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:29.954708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:29.955298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:29.955580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:29.955848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:29.957441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:30.048256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:30.049894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd3362-316a-4ee4-a22e-ab83225b0c18 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:30.068220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 719/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:32.145502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad84bb-34ff-40b8-8f68-944c29e38fcc None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:32.146024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad84bb-34ff-40b8-8f68-944c29e38fcc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:32.146024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad84bb-34ff-40b8-8f68-944c29e38fcc None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:32.147497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:32.152983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1354c-2449-455a-a518-3391cc539455 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:32.153424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1354c-2449-455a-a518-3391cc539455 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:32.153554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1354c-2449-455a-a518-3391cc539455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:32.194323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:32.220384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7bc1354c-2449-455a-a518-3391cc539455 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:32.221581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7bc1354c-2449-455a-a518-3391cc539455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:32.317469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:32.611201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad84bb-34ff-40b8-8f68-944c29e38fcc None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:32.612779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6fad84bb-34ff-40b8-8f68-944c29e38fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:32.715586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad84bb-34ff-40b8-8f68-944c29e38fcc None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:32.748298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:32.789468 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:32.790076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:32.790357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:32.790670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:32.792267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:32.900429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:32.902039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687ddbc-1e42-4cd9-8592-6cb6c72bc3d2 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:32.921659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 723/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:35.204693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f696-a26c-4824-b270-41f8b7c232a6 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:35.205293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f696-a26c-4824-b270-41f8b7c232a6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:35.205293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f696-a26c-4824-b270-41f8b7c232a6 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:35.206637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:35.211922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd448e2-6418-4a94-ac9b-53f8535bc493 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:35.212312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd448e2-6418-4a94-ac9b-53f8535bc493 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:35.212465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd448e2-6418-4a94-ac9b-53f8535bc493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:35.278848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7bd448e2-6418-4a94-ac9b-53f8535bc493 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:35.280676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7bd448e2-6418-4a94-ac9b-53f8535bc493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:35.293298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:35.381224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:35.675374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f696-a26c-4824-b270-41f8b7c232a6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:35.676904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bb52f696-a26c-4824-b270-41f8b7c232a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:35.780605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f696-a26c-4824-b270-41f8b7c232a6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:35.794819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:35.858911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:35.859512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:35.859791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:35.860073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:35.861641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:35.969462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:35.970944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f7a52-d912-4840-a04f-d02c2e458dc0 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:35.989044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 722/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:38.553733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3bc5c-3ca4-4234-907f-565f30fdbc76 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:38.554273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3bc5c-3ca4-4234-907f-565f30fdbc76 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:38.554273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3bc5c-3ca4-4234-907f-565f30fdbc76 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:38.555671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:38.560779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfa706-bc28-4ee2-bbce-a213ebe92070 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:38.561728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfa706-bc28-4ee2-bbce-a213ebe92070 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:38.561881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfa706-bc28-4ee2-bbce-a213ebe92070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:38.608888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:38.626627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-63cfa706-bc28-4ee2-bbce-a213ebe92070 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:38.627821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-63cfa706-bc28-4ee2-bbce-a213ebe92070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:38.728111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:39.016869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3bc5c-3ca4-4234-907f-565f30fdbc76 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:39.019367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-50f3bc5c-3ca4-4234-907f-565f30fdbc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:39.124625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3bc5c-3ca4-4234-907f-565f30fdbc76 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:39.167312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:39.200927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:39.201697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:39.201989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:39.202263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:39.203944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:39.310794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:39.312415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10936785-3797-4072-8e76-5d12d696e6fb service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:39.330267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 726/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:41.618335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28082b6-ba3a-472b-bf6d-a5ad9dcd0e9a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:41.618915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28082b6-ba3a-472b-bf6d-a5ad9dcd0e9a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:41.618915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28082b6-ba3a-472b-bf6d-a5ad9dcd0e9a None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:41.620275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:41.626290 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fd39-0709-4da2-8ede-8bdcd5c2f688 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:41.629735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fd39-0709-4da2-8ede-8bdcd5c2f688 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:41.629735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fd39-0709-4da2-8ede-8bdcd5c2f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:41.693204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ad18fd39-0709-4da2-8ede-8bdcd5c2f688 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:41.694405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ad18fd39-0709-4da2-8ede-8bdcd5c2f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:41.714998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:41.790326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:42.074787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28082b6-ba3a-472b-bf6d-a5ad9dcd0e9a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:42.076352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b28082b6-ba3a-472b-bf6d-a5ad9dcd0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:42.180985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28082b6-ba3a-472b-bf6d-a5ad9dcd0e9a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:42.202881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:42.255886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:42.256489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:42.256768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:42.257040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:42.258663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:42.367794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:42.369146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fbb0a-8f37-4233-90c4-944f13fa16db service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:42.387313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 725/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:44.585689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b509d1-7dfd-4173-bcf3-75a88e9e9764 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:44.586253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b509d1-7dfd-4173-bcf3-75a88e9e9764 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:44.586357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b509d1-7dfd-4173-bcf3-75a88e9e9764 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:44.588613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:44.594078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67333-d683-49cc-84b3-a7e555402e73 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:44.594553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67333-d683-49cc-84b3-a7e555402e73 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:44.594650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67333-d683-49cc-84b3-a7e555402e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:44.657262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:44.659949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c6a67333-d683-49cc-84b3-a7e555402e73 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:44.661168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c6a67333-d683-49cc-84b3-a7e555402e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:44.759790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:45.053719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b509d1-7dfd-4173-bcf3-75a88e9e9764 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:45.055296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-13b509d1-7dfd-4173-bcf3-75a88e9e9764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:45.159204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b509d1-7dfd-4173-bcf3-75a88e9e9764 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:45.215077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:45.240377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:45.240988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:45.241269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:45.241539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:45.243174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:45.349852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:45.351234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b394-21e7-46de-b94f-4fda59d5324a service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:45.370107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 729/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:47.618645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6f25f-11a7-4475-b47b-0ab022de3d35 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:47.619225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6f25f-11a7-4475-b47b-0ab022de3d35 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:47.619225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6f25f-11a7-4475-b47b-0ab022de3d35 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:47.620551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:47.626342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039044-e42b-40ae-9b6a-f811b4915e1f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:47.626798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039044-e42b-40ae-9b6a-f811b4915e1f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:47.626914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039044-e42b-40ae-9b6a-f811b4915e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:47.692410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9f039044-e42b-40ae-9b6a-f811b4915e1f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:47.693621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9f039044-e42b-40ae-9b6a-f811b4915e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:47.722587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:47.794459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:48.077720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6f25f-11a7-4475-b47b-0ab022de3d35 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:48.079284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c4e6f25f-11a7-4475-b47b-0ab022de3d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:48.183526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6f25f-11a7-4475-b47b-0ab022de3d35 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:48.212210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:48.256446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:48.257038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:48.257315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:48.257585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:48.259187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:48.367671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:48.369029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a3f85-91ab-4fe3-af01-619d6948e8dd service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:48.387650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 728/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:45:50.645387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49de62-f959-416a-9ff5-4c287db051ca None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:50.645990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49de62-f959-416a-9ff5-4c287db051ca None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:50.645990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49de62-f959-416a-9ff5-4c287db051ca None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:50.647316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:50.652885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855360-9e9b-43f7-9b32-16e00c7af4c3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:50.653352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855360-9e9b-43f7-9b32-16e00c7af4c3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:50.653473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855360-9e9b-43f7-9b32-16e00c7af4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:50.718844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-fa855360-9e9b-43f7-9b32-16e00c7af4c3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:50.720070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fa855360-9e9b-43f7-9b32-16e00c7af4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:50.728416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:50.817134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:51.101605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49de62-f959-416a-9ff5-4c287db051ca None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:51.103169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1e49de62-f959-416a-9ff5-4c287db051ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:51.207142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49de62-f959-416a-9ff5-4c287db051ca None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:51.261366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:51.280428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:51.281220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:51.281556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:51.281825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:51.283419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:51.391046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:51.392399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8f58b-d468-4812-8104-7fea9939b911 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:51.411424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 732/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:53.602721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e74d-eeac-49e2-8f6a-e330dc02e5d1 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:53.603275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e74d-eeac-49e2-8f6a-e330dc02e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:53.603275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e74d-eeac-49e2-8f6a-e330dc02e5d1 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:53.604636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:53.611372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ef395-7356-4c5d-abf6-fb04bae8be54 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:53.611765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ef395-7356-4c5d-abf6-fb04bae8be54 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:53.611942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ef395-7356-4c5d-abf6-fb04bae8be54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:53.681536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-828ef395-7356-4c5d-abf6-fb04bae8be54 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:53.682776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-828ef395-7356-4c5d-abf6-fb04bae8be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:53.722051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:53.781969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:45:54.066039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e74d-eeac-49e2-8f6a-e330dc02e5d1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:54.067663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9212e74d-eeac-49e2-8f6a-e330dc02e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:54.176459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e74d-eeac-49e2-8f6a-e330dc02e5d1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:54.214177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:54.251007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:54.251606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:54.251884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:54.252152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:54.253737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:54.360686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:54.362039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1853b03-7435-404a-a5ce-68b4d7007f62 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:54.382554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 731/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:45:56.642693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1e11-7121-4a12-993c-d8fdeb27ec22 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:56.643285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1e11-7121-4a12-993c-d8fdeb27ec22 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:56.643285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1e11-7121-4a12-993c-d8fdeb27ec22 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:56.644581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:56.649889 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628adb-e2eb-4440-ae55-b7d3a4cc6582 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:56.650283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628adb-e2eb-4440-ae55-b7d3a4cc6582 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:56.650433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628adb-e2eb-4440-ae55-b7d3a4cc6582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:56.831436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8b628adb-e2eb-4440-ae55-b7d3a4cc6582 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:45:56.832644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8b628adb-e2eb-4440-ae55-b7d3a4cc6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:56.850689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:56.929780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:45:57.266795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1e11-7121-4a12-993c-d8fdeb27ec22 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:45:57.268392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e39a1e11-7121-4a12-993c-d8fdeb27ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:57.394547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1e11-7121-4a12-993c-d8fdeb27ec22 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:45:57.478308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:45:57.486993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:45:57.488025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:57.488510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:57.489085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:57.492220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:45:57.623018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:45:57.625521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ea0c0-0abe-4755-ab9e-8ae0ac53d27f service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:45:57.649996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 735/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:45:59.947096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efaa5-4e4b-4fc4-92cf-ebda488d995a None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:59.947656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efaa5-4e4b-4fc4-92cf-ebda488d995a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:59.947656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efaa5-4e4b-4fc4-92cf-ebda488d995a None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:45:59.949155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:45:59.954691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f6f2-90c9-4782-95bc-013e8fef8082 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:45:59.955180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f6f2-90c9-4782-95bc-013e8fef8082 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:45:59.955287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4f6f2-90c9-4782-95bc-013e8fef8082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:00.022197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c9f4f6f2-90c9-4782-95bc-013e8fef8082 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:00.023360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c9f4f6f2-90c9-4782-95bc-013e8fef8082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:00.072987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:00.122678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:00.412592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efaa5-4e4b-4fc4-92cf-ebda488d995a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:00.414107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5d3efaa5-4e4b-4fc4-92cf-ebda488d995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:00.521335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efaa5-4e4b-4fc4-92cf-ebda488d995a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:00.570305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:00.596702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:00.597305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:00.597607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:00.597875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:00.599566 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:00.708376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:00.709798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dff40-24d9-4607-8862-9f72f7fb9b14 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:00.728432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 734/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:46:10.130938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=22 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:10.726197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=66 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:20.767354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e4b2-2e64-4c76-aecc-b5dd4d075ddd None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:20.767896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e4b2-2e64-4c76-aecc-b5dd4d075ddd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:20.767896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e4b2-2e64-4c76-aecc-b5dd4d075ddd None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:20.769260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 737/1471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:20.774851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6740bf-02ca-445f-8af2-4fa315f27a3a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:20.775250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6740bf-02ca-445f-8af2-4fa315f27a3a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:20.775397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6740bf-02ca-445f-8af2-4fa315f27a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:20.842638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ce6740bf-02ca-445f-8af2-4fa315f27a3a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:20.843847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ce6740bf-02ca-445f-8af2-4fa315f27a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:20.937155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 735/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:21.238662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca809-90b7-4d17-8a1d-23881929cb5b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:21.238948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca809-90b7-4d17-8a1d-23881929cb5b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:21.239218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca809-90b7-4d17-8a1d-23881929cb5b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:21.240538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 738/1473] 10.222.0.27 () {54 vars in 966 bytes} [Wed Sep 14 02:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:21.245635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04750-774b-4b44-a3b4-c8b75c980047 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:21.245920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04750-774b-4b44-a3b4-c8b75c980047 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:21.246195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04750-774b-4b44-a3b4-c8b75c980047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:21.321059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-72d04750-774b-4b44-a3b4-c8b75c980047 None None] MFA Rules not processed for user `27f39b9d908644379d12e3e0b4fc4635`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:21.322257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-72d04750-774b-4b44-a3b4-c8b75c980047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:21.343001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:21.397492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 736/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Wed Sep 14 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:21.405973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca809-90b7-4d17-8a1d-23881929cb5b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:21.407494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e92ca809-90b7-4d17-8a1d-23881929cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:21.511002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca809-90b7-4d17-8a1d-23881929cb5b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:21.584276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:21.584884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:21.585160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:21.585425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:21.587058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:21.643555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:21.825116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:21.827351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac98c5-65a6-4b01-aea7-002b45076ce9 service glance] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:21.846077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 739/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:46:24.089196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f519b5-a35c-486f-a873-79176375b830 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:24.089729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f519b5-a35c-486f-a873-79176375b830 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:24.089729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f519b5-a35c-486f-a873-79176375b830 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:24.091116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 737/1476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:24.097000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50747b-a344-40d4-b4b6-6307cba21bc3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:24.097440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50747b-a344-40d4-b4b6-6307cba21bc3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:24.097541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50747b-a344-40d4-b4b6-6307cba21bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:24.162436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-cf50747b-a344-40d4-b4b6-6307cba21bc3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:24.163675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-cf50747b-a344-40d4-b4b6-6307cba21bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:24.258664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 740/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:24.534688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f519b5-a35c-486f-a873-79176375b830 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:24.536228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a1f519b5-a35c-486f-a873-79176375b830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:24.659075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f519b5-a35c-486f-a873-79176375b830 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:24.706069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:24.751751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:46:24.759942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:46:24.760554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c7f1a-f8fe-48cf-b790-4000e2eb5420 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:24.776020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 738/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Sep 14 02:46:24 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:46:26.946065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de6db-6184-48a1-83ba-5c8d9d0b7212 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:26.946670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de6db-6184-48a1-83ba-5c8d9d0b7212 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:26.946781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de6db-6184-48a1-83ba-5c8d9d0b7212 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:26.948103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 741/1479] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:26.954125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e822-ed72-4f5e-9f3b-c9e833dc6674 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:26.954588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e822-ed72-4f5e-9f3b-c9e833dc6674 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:26.954690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5e822-ed72-4f5e-9f3b-c9e833dc6674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:27.019600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6de5e822-ed72-4f5e-9f3b-c9e833dc6674 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:27.020787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6de5e822-ed72-4f5e-9f3b-c9e833dc6674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:27.116190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 739/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:27.408272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de6db-6184-48a1-83ba-5c8d9d0b7212 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:27.409754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-cd3de6db-6184-48a1-83ba-5c8d9d0b7212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:27.419355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:27.559395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de6db-6184-48a1-83ba-5c8d9d0b7212 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:27.639084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:27.672365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:27.672973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:27.673247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:27.673520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:27.675135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:27.766958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:27.768545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bb811-b597-480a-95a3-92b65605ff32 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:27.787394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 742/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:46:30.118612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90388d5-1dd2-48c6-8306-434a71a187a7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:30.119147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90388d5-1dd2-48c6-8306-434a71a187a7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:30.119147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90388d5-1dd2-48c6-8306-434a71a187a7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:30.120475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 740/1482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:30.126318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104498e-e40a-4e5d-a98c-89c62f16893e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:30.126748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104498e-e40a-4e5d-a98c-89c62f16893e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:30.126907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104498e-e40a-4e5d-a98c-89c62f16893e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:30.191817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2104498e-e40a-4e5d-a98c-89c62f16893e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:30.193039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2104498e-e40a-4e5d-a98c-89c62f16893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:30.241712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:30.291509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 743/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:30.576915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90388d5-1dd2-48c6-8306-434a71a187a7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:30.578417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e90388d5-1dd2-48c6-8306-434a71a187a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:30.608610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:30.686800 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90388d5-1dd2-48c6-8306-434a71a187a7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:30.758564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:30.759160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:30.759432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:30.759695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:30.761300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:30.838419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:30.872916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:30.874367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb9d17-9252-43d2-a8c1-8a792604fbcf service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:30.895648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 741/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:46:33.120881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef11751-79a4-4bcd-a268-84a6711ff7ef None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:33.121373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef11751-79a4-4bcd-a268-84a6711ff7ef None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:33.121491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef11751-79a4-4bcd-a268-84a6711ff7ef None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:33.122853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 744/1485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:33.128120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8d576-87c4-432b-a099-9389cd3e048f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:33.128567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8d576-87c4-432b-a099-9389cd3e048f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:33.128674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8d576-87c4-432b-a099-9389cd3e048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:33.197670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c6c8d576-87c4-432b-a099-9389cd3e048f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:33.198903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c6c8d576-87c4-432b-a099-9389cd3e048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:33.293782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 742/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:33.591318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef11751-79a4-4bcd-a268-84a6711ff7ef None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:33.593473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2ef11751-79a4-4bcd-a268-84a6711ff7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:33.693920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef11751-79a4-4bcd-a268-84a6711ff7ef None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:33.768034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:33.769494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:33.770134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:33.770410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:33.770709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:33.772348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:33.884773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:33.886199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938caa0-a98f-4911-9f8b-75ab89956de7 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:33.905394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 745/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:46:36.155631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ca29-051e-4759-a924-b220396c1c0d None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:36.156147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ca29-051e-4759-a924-b220396c1c0d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:36.156262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ca29-051e-4759-a924-b220396c1c0d None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:36.157559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 743/1488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:36.162876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3bc0-97b2-4ac7-b452-66a7484d1ce0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:36.163297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3bc0-97b2-4ac7-b452-66a7484d1ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:36.163399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3bc0-97b2-4ac7-b452-66a7484d1ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:36.229803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-157a3bc0-97b2-4ac7-b452-66a7484d1ce0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:36.231036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-157a3bc0-97b2-4ac7-b452-66a7484d1ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:36.283520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:36.326124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 746/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:36.618289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ca29-051e-4759-a924-b220396c1c0d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:36.619834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bf37ca29-051e-4759-a924-b220396c1c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:36.655844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:36.722629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ca29-051e-4759-a924-b220396c1c0d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:36.796141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:36.796743 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:36.797020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:36.797290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:36.798912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:36.879920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:36.908523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:36.909953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7220b1-dd1e-41fa-8e20-92fdc7416774 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:36.928152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 744/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:46:39.439461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354437d8-f354-4c36-b144-8751d2dd44f5 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:39.440024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354437d8-f354-4c36-b144-8751d2dd44f5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:39.440024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354437d8-f354-4c36-b144-8751d2dd44f5 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:39.441346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 747/1491] 10.222.0.27 () {54 vars in 927 bytes} [Wed Sep 14 02:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:46:39.446569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba620-2c94-4c8b-a26b-fc482511d020 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:39.446970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba620-2c94-4c8b-a26b-fc482511d020 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:39.447127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba620-2c94-4c8b-a26b-fc482511d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:39.512155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-91fba620-2c94-4c8b-a26b-fc482511d020 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:46:39.514505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-91fba620-2c94-4c8b-a26b-fc482511d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:39.610639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 745/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Sep 14 02:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:46:39.908620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354437d8-f354-4c36-b144-8751d2dd44f5 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:46:39.910266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-354437d8-f354-4c36-b144-8751d2dd44f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:40.015380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354437d8-f354-4c36-b144-8751d2dd44f5 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:46:40.089045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:46:40.089797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:46:40.090133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:46:40.090796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:46:40.092782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:46:40.101686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:40.202401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:46:40.203844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23be46-9c0f-45de-a481-c7719cba9061 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:46:40.222209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 748/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:46:49.609395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=82 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:46:50.219950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=50 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:48:23.864995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:23.865552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:23.865552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:23.945445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:48:23.946679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:24.048504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 746/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:48:24.056516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.057023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.057131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.078974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:48:24.080174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:24.088648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 749/1495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:48:24.093381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.103047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5390-00e2-4bd7-b9bf-a70dab9f155f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.107681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.108359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.108635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.108932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.109564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:48:24.109860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.110899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:24.110899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:48:24.110899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:48:24.111778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.123834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 747/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:48:24.131696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.141482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772b36b-0ef2-4c42-95cf-69af4926595d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.148278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.149272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.149776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.150214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.150908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.152620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:24.152620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:48:24.152620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:48:24.153792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.264087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 750/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:48:24 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:48:24.268325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.278133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e253-a4b7-41f8-8ac6-d97662a26390 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.327673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:48:24.334280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.336022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.336022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.336022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.336022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.337191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:24.337191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:48:24.337191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:48:24.338429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.405296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 748/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:48:24 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:48:24.409371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.419509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cdb88-ed07-4114-a9d1-4066d9d49b87 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.424732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.425324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.425599 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.425866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.426527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.427659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:24.427659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:48:24.427659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:48:24.428529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.442141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 751/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:48:24.446315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.456629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c9229-abf5-4263-a167-4047bcbeefa9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.461359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.461949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.462226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.462521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.463156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.464160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:24.464160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:48:24.464160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:48:24.465035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6d243-a0d0-4085-90e7-1457998a712c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.479415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 749/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:48:24.483929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.498726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8bb9f-91d0-4aa9-84a8-79e72f99cb42 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.503385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.504030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.504307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.504579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] PATH_INFO: `/v3/projects/7595eacde71a4341a913628b01d7a3f3/users/6d7acecd7c934a3fabce5baadc7c9e6b/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.519230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7595eacde71a4341a913628b01d7a3f3, user_id=6d7acecd7c934a3fabce5baadc7c9e6b, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.520253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:24.520253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:48:24.520253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:48:24.522165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30d1ec-d4ba-4686-92a8-7560b0bf0323 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.582206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 752/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:48:24 2022] PUT /identity/v3/projects/7595eacde71a4341a913628b01d7a3f3/users/6d7acecd7c934a3fabce5baadc7c9e6b/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:48:24.598751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40bed-d34a-418a-b8d8-8ac9b789aa1e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.599039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40bed-d34a-418a-b8d8-8ac9b789aa1e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.599317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40bed-d34a-418a-b8d8-8ac9b789aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.627952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c2b40bed-d34a-418a-b8d8-8ac9b789aa1e None None] MFA Rules not processed for user `6d7acecd7c934a3fabce5baadc7c9e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:48:24.629145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c2b40bed-d34a-418a-b8d8-8ac9b789aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:24.690936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 750/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:48:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:48:24.704652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff170-1952-4b60-b5be-7dcbc565cffb None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.704938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff170-1952-4b60-b5be-7dcbc565cffb None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.705213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ff170-1952-4b60-b5be-7dcbc565cffb None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.706590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 753/1503] 10.222.0.27 () {54 vars in 964 bytes} [Wed Sep 14 02:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:48:24.711569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75032-55f2-411a-83da-341e709b8af1 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.711853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75032-55f2-411a-83da-341e709b8af1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.712120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75032-55f2-411a-83da-341e709b8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.769655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-69d75032-55f2-411a-83da-341e709b8af1 None None] MFA Rules not processed for user `d1aaf929efbc4f818d2f0b133d449f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:48:24.770873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-69d75032-55f2-411a-83da-341e709b8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:24.843761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 751/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Sep 14 02:48:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:48:24.851523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ff170-1952-4b60-b5be-7dcbc565cffb None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.862066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ff170-1952-4b60-b5be-7dcbc565cffb None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:24.865583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:24.866172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.866450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.866750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.875474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:24.876884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:24.885582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 754/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:48:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:48:24.931713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57017a44-d999-40d1-abb8-9c1990ce7d09 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:24.932128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57017a44-d999-40d1-abb8-9c1990ce7d09 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:24.932271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57017a44-d999-40d1-abb8-9c1990ce7d09 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:24.933526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 752/1506] 10.222.0.27 () {52 vars in 830 bytes} [Wed Sep 14 02:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:48:24.937308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:24.999699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cafc5e-8de1-4356-9f02-09bd98284e4a service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:25.004307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:25.004926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:25.005210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:25.005486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] PATH_INFO: `/v3/users/6d7acecd7c934a3fabce5baadc7c9e6b` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:25.006652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7acecd7c934a3fabce5baadc7c9e6b)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:25.007650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:25.007650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:48:25.007650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:48:25.008868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:25.246390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7acecd7c934a3fabce5baadc7c9e6b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:25.302139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7acecd7c934a3fabce5baadc7c9e6b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:25.302788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7acecd7c934a3fabce5baadc7c9e6b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:25.303433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7acecd7c934a3fabce5baadc7c9e6b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:25.318389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7acecd7c934a3fabce5baadc7c9e6b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:25.339151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:48:25.348011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 755/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:48:24 2022] DELETE /identity/v3/users/6d7acecd7c934a3fabce5baadc7c9e6b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:48:25.352523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:25.352806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:25.353077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:25.372393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:48:25.373725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:25.382817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:48:25.462625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 753/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:48:25.473196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:25.474632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:25.552482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bce1f-6bc6-4745-81c0-296b5e18fc8f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:25.556043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7eb1f-5571-47c3-9c41-d79c965f84b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:25.556651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7eb1f-5571-47c3-9c41-d79c965f84b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:25.556930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7eb1f-5571-47c3-9c41-d79c965f84b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:25.557202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7eb1f-5571-47c3-9c41-d79c965f84b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:25.566854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7eb1f-5571-47c3-9c41-d79c965f84b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:25.568272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7eb1f-5571-47c3-9c41-d79c965f84b9 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:25.578401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 756/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:48:26.030220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:48:26.031661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:48:26.043516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198350-13b2-4616-b85e-a68f81d1bd05 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:48:26.048443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:48:26.049068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:48:26.049341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:48:26.049610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] PATH_INFO: `/v3/projects/7595eacde71a4341a913628b01d7a3f3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:48:26.050795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7595eacde71a4341a913628b01d7a3f3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:48:26.051840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:48:26.051840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:48:26.051840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:48:26.052975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:48:26.174768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7595eacde71a4341a913628b01d7a3f3', 'request_id': 'req-5c5589a9-be91-4a36-844d-e9524c7755f9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:26.189972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7595eacde71a4341a913628b01d7a3f3', 'request_id': 'req-5c5589a9-be91-4a36-844d-e9524c7755f9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:26.276722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7595eacde71a4341a913628b01d7a3f3', 'request_id': 'req-5c5589a9-be91-4a36-844d-e9524c7755f9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:26.289193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] The token cache is being invalidate because project 7595eacde71a4341a913628b01d7a3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:48:26.289479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:26.290197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5c5589a9-be91-4a36-844d-e9524c7755f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:48:26.291718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 754/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:48:26 2022] DELETE /identity/v3/projects/7595eacde71a4341a913628b01d7a3f3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:48:35.573444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:48:36.286111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:49:58.509957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651b2d-e2a5-48b6-ac49-0095b097ca10 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:49:58.510582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651b2d-e2a5-48b6-ac49-0095b097ca10 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:49:58.510582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651b2d-e2a5-48b6-ac49-0095b097ca10 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:49:58.511871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:49:58.516865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b41f-884a-44cf-9348-97bcf35a2128 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:49:58.517325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b41f-884a-44cf-9348-97bcf35a2128 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:49:58.517437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b41f-884a-44cf-9348-97bcf35a2128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:49:58.539059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d9c8b41f-884a-44cf-9348-97bcf35a2128 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:49:58.540266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d9c8b41f-884a-44cf-9348-97bcf35a2128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:49:58.598728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:49:58.752335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651b2d-e2a5-48b6-ac49-0095b097ca10 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:49:58.754027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-54651b2d-e2a5-48b6-ac49-0095b097ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:49:58.862534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651b2d-e2a5-48b6-ac49-0095b097ca10 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:49:58.868272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db0729-cb64-4c09-883f-ab1b8258f481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:49:58.868916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0729-cb64-4c09-883f-ab1b8258f481 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:49:58.869195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0729-cb64-4c09-883f-ab1b8258f481 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:49:58.869465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db0729-cb64-4c09-883f-ab1b8258f481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:49:58.878198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db0729-cb64-4c09-883f-ab1b8258f481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:49:58.879928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db0729-cb64-4c09-883f-ab1b8258f481 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:49:58.890046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 758/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:00.035982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecde594-4f94-48d9-8f8e-65760e49d9ce None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:00.036562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecde594-4f94-48d9-8f8e-65760e49d9ce None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:00.036562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecde594-4f94-48d9-8f8e-65760e49d9ce None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:00.037924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:00.045157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12092-b021-49f5-a332-34331a2ba061 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:00.045629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12092-b021-49f5-a332-34331a2ba061 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:00.045745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12092-b021-49f5-a332-34331a2ba061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:00.067788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-91e12092-b021-49f5-a332-34331a2ba061 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:00.068980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-91e12092-b021-49f5-a332-34331a2ba061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:00.078318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:00.232032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecde594-4f94-48d9-8f8e-65760e49d9ce None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:00.247084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecde594-4f94-48d9-8f8e-65760e49d9ce None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:00.252838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a81a0-00cd-48c1-9edf-a74b527b2fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:00.253444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a81a0-00cd-48c1-9edf-a74b527b2fb8 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:00.253728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a81a0-00cd-48c1-9edf-a74b527b2fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:00.254002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a81a0-00cd-48c1-9edf-a74b527b2fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:00.262976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a81a0-00cd-48c1-9edf-a74b527b2fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:00.264568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a81a0-00cd-48c1-9edf-a74b527b2fb8 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:00.273982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 757/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:00.509865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dce14e-2908-428c-af48-fe54f19d5602 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:00.510158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dce14e-2908-428c-af48-fe54f19d5602 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:00.510423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dce14e-2908-428c-af48-fe54f19d5602 None None] PATH_INFO: `/v3` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:00.511738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 760/1517] 10.222.0.23 () {54 vars in 925 bytes} [Wed Sep 14 02:50:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:50:00.521457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54d65e-99fe-451d-9124-3439f1a40b77 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:00.521745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54d65e-99fe-451d-9124-3439f1a40b77 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:00.522099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54d65e-99fe-451d-9124-3439f1a40b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:00.575586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8b54d65e-99fe-451d-9124-3439f1a40b77 None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:00.576909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8b54d65e-99fe-451d-9124-3439f1a40b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:00.647707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 758/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Sep 14 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:04.477418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335321-4af2-48b5-8cd5-a229445394c2 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:04.477995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335321-4af2-48b5-8cd5-a229445394c2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:04.478183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0335321-4af2-48b5-8cd5-a229445394c2 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:04.479598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 761/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 14 02:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:04.485221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c7c09-3d0a-4d8d-b801-6f77e8902de8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:04.485671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c7c09-3d0a-4d8d-b801-6f77e8902de8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:04.485787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c7c09-3d0a-4d8d-b801-6f77e8902de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:04.505058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9c8c7c09-3d0a-4d8d-b801-6f77e8902de8 None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:04.506249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9c8c7c09-3d0a-4d8d-b801-6f77e8902de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:04.515569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 759/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 14 02:50:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:50:04.523278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0335321-4af2-48b5-8cd5-a229445394c2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:04.537072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0335321-4af2-48b5-8cd5-a229445394c2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:04.541924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89158b46-3464-4be1-8a4f-af8cc7c9753f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:04.542534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158b46-3464-4be1-8a4f-af8cc7c9753f service placement] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:04.542811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158b46-3464-4be1-8a4f-af8cc7c9753f service placement] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:04.543078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158b46-3464-4be1-8a4f-af8cc7c9753f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:04.551738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89158b46-3464-4be1-8a4f-af8cc7c9753f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:04.553281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89158b46-3464-4be1-8a4f-af8cc7c9753f service placement] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:04.564233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 762/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:11.747289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9ebb-4747-4baa-afd8-31949a99e4d3 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:11.747870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9ebb-4747-4baa-afd8-31949a99e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:11.747870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9ebb-4747-4baa-afd8-31949a99e4d3 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:11.749203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:11.755261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307f124-1ed0-4ba3-a8ce-d19926579c35 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:11.755696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307f124-1ed0-4ba3-a8ce-d19926579c35 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:11.755800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307f124-1ed0-4ba3-a8ce-d19926579c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:11.775037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a307f124-1ed0-4ba3-a8ce-d19926579c35 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:11.776217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a307f124-1ed0-4ba3-a8ce-d19926579c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:11.785016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:11.938319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9ebb-4747-4baa-afd8-31949a99e4d3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:11.953779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9ebb-4747-4baa-afd8-31949a99e4d3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:11.959400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e705-d5c8-4078-8326-c0c76843a617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:11.960003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e705-d5c8-4078-8326-c0c76843a617 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:11.960275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e705-d5c8-4078-8326-c0c76843a617 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:11.960543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e705-d5c8-4078-8326-c0c76843a617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:11.969089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e705-d5c8-4078-8326-c0c76843a617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:11.972665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e705-d5c8-4078-8326-c0c76843a617 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:11.980035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 761/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:13.054269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefc2e8-4283-4ef5-84fa-1bbab157bd3c None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:13.054838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefc2e8-4283-4ef5-84fa-1bbab157bd3c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:13.054838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefc2e8-4283-4ef5-84fa-1bbab157bd3c None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:13.056130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 02:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:13.062285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163a0b1-4e27-48a4-b2b9-f4fbc177f603 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:13.062741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163a0b1-4e27-48a4-b2b9-f4fbc177f603 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:13.062867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163a0b1-4e27-48a4-b2b9-f4fbc177f603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:13.082948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a163a0b1-4e27-48a4-b2b9-f4fbc177f603 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:13.084127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a163a0b1-4e27-48a4-b2b9-f4fbc177f603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:13.092730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 02:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:13.244706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefc2e8-4283-4ef5-84fa-1bbab157bd3c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:13.258734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefc2e8-4283-4ef5-84fa-1bbab157bd3c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:13.264639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df5c7c-128a-47c5-b99b-beff90a1d963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:13.265221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5c7c-128a-47c5-b99b-beff90a1d963 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:13.265496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5c7c-128a-47c5-b99b-beff90a1d963 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:13.265763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5c7c-128a-47c5-b99b-beff90a1d963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:13.273562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df5c7c-128a-47c5-b99b-beff90a1d963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:13.275130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df5c7c-128a-47c5-b99b-beff90a1d963 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:13.285404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 765/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:17.359155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570d49-aac2-4bd7-957d-0534a1938a23 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:17.359689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570d49-aac2-4bd7-957d-0534a1938a23 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:17.359689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570d49-aac2-4bd7-957d-0534a1938a23 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:17.360985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:17.366127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f482c9-6c33-45a0-912f-2d65f8a463b4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:17.366565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f482c9-6c33-45a0-912f-2d65f8a463b4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:17.366712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f482c9-6c33-45a0-912f-2d65f8a463b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:17.386732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-83f482c9-6c33-45a0-912f-2d65f8a463b4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:17.388851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-83f482c9-6c33-45a0-912f-2d65f8a463b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:17.396610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:17.689395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86570d49-aac2-4bd7-957d-0534a1938a23 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:17.691167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-86570d49-aac2-4bd7-957d-0534a1938a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:17.719967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:50:17.749349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86570d49-aac2-4bd7-957d-0534a1938a23 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:17.752913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb777-5700-487b-946d-5afbd47a07ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:17.753511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb777-5700-487b-946d-5afbd47a07ac service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:17.753793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb777-5700-487b-946d-5afbd47a07ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:17.754069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb777-5700-487b-946d-5afbd47a07ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:17.763576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb777-5700-487b-946d-5afbd47a07ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:17.765005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb777-5700-487b-946d-5afbd47a07ac service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:17.775181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 764/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:19.930129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413093-b75c-4644-bf8d-940a9cac6b61 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:19.930689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413093-b75c-4644-bf8d-940a9cac6b61 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:19.930803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413093-b75c-4644-bf8d-940a9cac6b61 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:19.932076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:19.937847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ced0e-cde9-44d4-a5d9-c2a382b7118a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:19.938300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ced0e-cde9-44d4-a5d9-c2a382b7118a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:19.938400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ced0e-cde9-44d4-a5d9-c2a382b7118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:19.962290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-450ced0e-cde9-44d4-a5d9-c2a382b7118a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:19.963527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-450ced0e-cde9-44d4-a5d9-c2a382b7118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:19.972512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:20.265829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413093-b75c-4644-bf8d-940a9cac6b61 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:20.267563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-27413093-b75c-4644-bf8d-940a9cac6b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:20.280612 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413093-b75c-4644-bf8d-940a9cac6b61 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:20.284393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58a00-8236-43f5-af90-89cea4074750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:20.284984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58a00-8236-43f5-af90-89cea4074750 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:20.285288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58a00-8236-43f5-af90-89cea4074750 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:20.285560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58a00-8236-43f5-af90-89cea4074750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:20.294649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58a00-8236-43f5-af90-89cea4074750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:20.296079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be58a00-8236-43f5-af90-89cea4074750 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:20.305332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 768/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:24.006276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a014-4fa3-452d-8d79-f89e548a1319 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:24.006900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a014-4fa3-452d-8d79-f89e548a1319 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:24.007016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3a014-4fa3-452d-8d79-f89e548a1319 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:24.008389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:24.015425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c87182-c264-45c1-ab26-a0e7fedf9b6f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:24.016289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c87182-c264-45c1-ab26-a0e7fedf9b6f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:24.019911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c87182-c264-45c1-ab26-a0e7fedf9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:24.038560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-59c87182-c264-45c1-ab26-a0e7fedf9b6f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:24.039792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-59c87182-c264-45c1-ab26-a0e7fedf9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:24.048938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:50:24.372953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a014-4fa3-452d-8d79-f89e548a1319 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:24.374651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-25c3a014-4fa3-452d-8d79-f89e548a1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:24.432516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3a014-4fa3-452d-8d79-f89e548a1319 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:24.436100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e3e93-9ec3-48bb-8d34-7ca4986aafd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:24.436702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3e93-9ec3-48bb-8d34-7ca4986aafd1 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:24.436981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3e93-9ec3-48bb-8d34-7ca4986aafd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:24.437250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e3e93-9ec3-48bb-8d34-7ca4986aafd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:24.446104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3e93-9ec3-48bb-8d34-7ca4986aafd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:24.447567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e3e93-9ec3-48bb-8d34-7ca4986aafd1 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:24.457548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 767/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:26.610977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b420f-c852-4012-a8ba-b62ec070f339 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:26.611548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b420f-c852-4012-a8ba-b62ec070f339 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:26.611548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b420f-c852-4012-a8ba-b62ec070f339 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:26.612843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 02:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:50:26.617972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34580-2d00-40a7-9c6d-2f12f2f16001 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:26.618424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34580-2d00-40a7-9c6d-2f12f2f16001 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:26.618547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a34580-2d00-40a7-9c6d-2f12f2f16001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:26.638567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f0a34580-2d00-40a7-9c6d-2f12f2f16001 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:50:26.639768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f0a34580-2d00-40a7-9c6d-2f12f2f16001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:26.647594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 02:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:50:26.969192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b420f-c852-4012-a8ba-b62ec070f339 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:50:26.970922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bf8b420f-c852-4012-a8ba-b62ec070f339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:50:26.979125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=77 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:50:26.985465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b420f-c852-4012-a8ba-b62ec070f339 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:50:26.988977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00079868-38a9-42a8-8684-24954ae541b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:50:26.989567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079868-38a9-42a8-8684-24954ae541b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:50:26.989845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079868-38a9-42a8-8684-24954ae541b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:50:26.990120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079868-38a9-42a8-8684-24954ae541b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:50:26.998948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00079868-38a9-42a8-8684-24954ae541b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:50:27.000349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00079868-38a9-42a8-8684-24954ae541b9 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:50:27.009923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 771/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:50:36.632979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=47 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:50:37.006075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:57.266605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.267261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.267261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.299502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.300729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.309830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 769/1540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.319034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb4afb-2692-409b-b526-a17196cf26b1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.320036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb4afb-2692-409b-b526-a17196cf26b1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.320534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb4afb-2692-409b-b526-a17196cf26b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.347727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7efb4afb-2692-409b-b526-a17196cf26b1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.349020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7efb4afb-2692-409b-b526-a17196cf26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.360250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 772/1541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.365215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:57.379668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16d861-baec-4e4d-86e3-2f81a0b02dbd None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:57.388189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:57.388818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.389101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.389379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.390037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:57.390342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:57.392040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:57.397444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232af8-9fef-49c2-a06d-e41516101c06 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.397749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232af8-9fef-49c2-a06d-e41516101c06 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.397995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232af8-9fef-49c2-a06d-e41516101c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.417288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 770/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:57.426671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:57.426899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-fa232af8-9fef-49c2-a06d-e41516101c06 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.427959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fa232af8-9fef-49c2-a06d-e41516101c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.438329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c06df-9469-45dc-9531-6e0a6d19d205 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:57.443078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 773/1543] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.457154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:57.457998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.458294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.458624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.459449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:57.460369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:51:57.460369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:51:57.460369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:51:57.461597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:57.462843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.463825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.464587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.498952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.500199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.519293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 774/1544] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.524462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:57.540529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0971bec-1be3-4155-9e35-b6c2269c0674 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:57.551610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:57.552249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.552524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.552786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.553549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:57.553858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:57.554899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:51:57.554899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:51:57.554899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:51:57.555798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81770078-cdc2-406a-9dd8-a391c1049719 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:57.570171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 775/1545] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:51:57.571526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f289b-73b8-416e-9089-b7b5443ba93c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.571807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f289b-73b8-416e-9089-b7b5443ba93c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.572079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f289b-73b8-416e-9089-b7b5443ba93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.603261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-387f289b-73b8-416e-9089-b7b5443ba93c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.604379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-387f289b-73b8-416e-9089-b7b5443ba93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.618170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 776/1546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.619657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.619937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.620959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.627671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 771/1547] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:57.628520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:57.648845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.650382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.768578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9f2e-1718-4901-9577-4adea6cb4553 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:57.769637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 777/1548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.770529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:57.780408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd3e6a-d93a-4676-87e4-37576825fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:57.781088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc637fa-0d8b-43af-8915-7db631a9b64b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:57.781213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3e6a-d93a-4676-87e4-37576825fe54 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.781429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3e6a-d93a-4676-87e4-37576825fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.781797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3e6a-d93a-4676-87e4-37576825fe54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.782434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3e6a-d93a-4676-87e4-37576825fe54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:57.784807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3e6a-d93a-4676-87e4-37576825fe54 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:57.786066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:57.786697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.786981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.787256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.788045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:57.789200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:51:57.789200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:51:57.789200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:51:57.790418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c51aa-00af-4c0e-bf2e-96e1ecdd69e1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:57.868060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 778/1549] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:57.869370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de2fda-1f8c-492d-be56-1dae81545f5b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.869660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de2fda-1f8c-492d-be56-1dae81545f5b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.869944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de2fda-1f8c-492d-be56-1dae81545f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.889872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-20de2fda-1f8c-492d-be56-1dae81545f5b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.891127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-20de2fda-1f8c-492d-be56-1dae81545f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.892777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 772/1550] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:57.894161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82bdd-90a4-46d5-83b4-db606c67922b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.894450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82bdd-90a4-46d5-83b4-db606c67922b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.894796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82bdd-90a4-46d5-83b4-db606c67922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.916744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a7d82bdd-90a4-46d5-83b4-db606c67922b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.917999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a7d82bdd-90a4-46d5-83b4-db606c67922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.956010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 779/1551] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.959775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99aa1-12f3-4744-8ccf-73f723eeaa91 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.959775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99aa1-12f3-4744-8ccf-73f723eeaa91 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.959775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99aa1-12f3-4744-8ccf-73f723eeaa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.978140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e4d99aa1-12f3-4744-8ccf-73f723eeaa91 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:57.979367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e4d99aa1-12f3-4744-8ccf-73f723eeaa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:57.982515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 773/1552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.982774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3145-d7ae-454b-8e31-558ce7248c1d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.983063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3145-d7ae-454b-8e31-558ce7248c1d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.983335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3145-d7ae-454b-8e31-558ce7248c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:57.989618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 780/1553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:57.992341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:57.992638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:57.992910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.003102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f47d3145-d7ae-454b-8e31-558ce7248c1d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.004307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f47d3145-d7ae-454b-8e31-558ce7248c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.012972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 774/1554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.013330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.014177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.014436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.014643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.014845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.022871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 781/1555] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.023678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.034747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d5935-775a-44be-b1db-135b1a5ef6f8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.038590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.039253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.039788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.039915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.040113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.040381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.041010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.042699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.048155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 775/1556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.048759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.057134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 782/1557] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:58.057134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.060903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8aada-6c9d-4b58-b505-4db6c708beec None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.065542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff6a41-81bc-40d4-a071-ea9798ffe5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.066120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90142f2-33f2-4a71-9f43-4c7dde1e2c5d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.066234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff6a41-81bc-40d4-a071-ea9798ffe5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.066403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff6a41-81bc-40d4-a071-ea9798ffe5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.066707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff6a41-81bc-40d4-a071-ea9798ffe5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.067333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff6a41-81bc-40d4-a071-ea9798ffe5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.069226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff6a41-81bc-40d4-a071-ea9798ffe5c6 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.070701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.071285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.071564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.071836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.072473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:58.072776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.075038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642aca1-e735-4fe6-b7c6-1be0aaf3f41c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.087322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 783/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:58.088640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6065ad-e71e-4a9f-8444-a2ee99de92d1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.088928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6065ad-e71e-4a9f-8444-a2ee99de92d1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.089830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6065ad-e71e-4a9f-8444-a2ee99de92d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.103970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:58.109870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0a6065ad-e71e-4a9f-8444-a2ee99de92d1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.111118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0a6065ad-e71e-4a9f-8444-a2ee99de92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.119053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 784/1559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.120150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523a22c-db46-4966-99e1-44d97dc86ab6 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.120488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523a22c-db46-4966-99e1-44d97dc86ab6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.120756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523a22c-db46-4966-99e1-44d97dc86ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.139800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1523a22c-db46-4966-99e1-44d97dc86ab6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.141028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1523a22c-db46-4966-99e1-44d97dc86ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.148698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 785/1560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.149809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.150087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.150355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.169588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.170763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.178882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 786/1561] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.182363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 776/1562] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.183702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.183977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.184265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.184533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.194594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc13f7-8989-48f4-b369-6a85f247246b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.200313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.200927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.208123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.208123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.208123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:58.208123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.208123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.208605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:58.208605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:58.214056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 777/1563] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:58.215513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.217298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 787/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:58.218030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.225068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa42de-410f-4bd4-a1e9-60d406f4a59d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.228539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf80fb6-0c86-4d68-8f43-83905ded90ca admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.229963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.230611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.231104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.231202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.231778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.233469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.234041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.234323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.234636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.234828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.236237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.236365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:58.237404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.248736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 778/1565] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:58.250070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.259758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb42a3-8102-47be-8bbf-ac044293be51 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.273341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.273975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.274281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.274600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.275257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:58.275559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.277994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.290851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 779/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:58.291778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.301391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb314d6-15fd-480f-aecd-bebdfbda12ee admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.306227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.306890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.307166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.307437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.308729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:58.309034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.310115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 788/1567] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.310650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.310999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.322735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 780/1568] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:58.331438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.341584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2738-1da5-43ed-8c00-f70106b48ab4 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.373239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf92ee-9f0b-427f-b99b-771263a86c5e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.377832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.378381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.378691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.378957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.379589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:58.379888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.381460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.393781 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 789/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:58.394589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.397331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.397839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.398281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.398596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.399239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.400962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.405904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec533d-0ad2-4d85-8fb1-b8f3f7686a40 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.410831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.411418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.411699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.411897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 781/1570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:58.412010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.412620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.412734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.414511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.423112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0995-5734-4141-8f9f-6aba741aac50 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.427769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.428348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.428626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.428898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.429528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:51:58.429828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.431427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.447537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 782/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:51:58.448317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.458570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c194a8-de41-4e88-b692-fa3492184161 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.463197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.463828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.464106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.464460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] PATH_INFO: `/v3/projects/b0bcf113f85a41ecada488b2b06c2fa1/users/a4cd49cba5ac42a999f95733cc3a466c/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.478911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0bcf113f85a41ecada488b2b06c2fa1, user_id=a4cd49cba5ac42a999f95733cc3a466c, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.483404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:51:58.483404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:51:58.483404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:51:58.483404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.561167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 790/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.562140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.570705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 783/1573] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:51:58 2022] PUT /identity/v3/projects/b0bcf113f85a41ecada488b2b06c2fa1/users/a4cd49cba5ac42a999f95733cc3a466c/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:51:58.571717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.634674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf2c0-f864-4f00-9f27-fd30179e5a33 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.640296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.640953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.641088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837ccb-f34a-4818-8450-669274501a8d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.641226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.641503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.642259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.644233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.645607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.646206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.646508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.646789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.647411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.649520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.754632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 791/1574] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.755446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.768283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 784/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.768469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:58.768570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.775847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6252a-5851-4b90-a5a0-b6a30c89605e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.788596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:58.821894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dda4b-135d-4cf8-8dc0-eb2113ad7b54 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.826983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.827592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.827868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.828139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.828766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.830734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.834617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.835273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.835552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.836069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.836447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.838344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:58.898051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 792/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.898832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.931767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 785/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:58.931767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:58.990397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccac8df-4e68-406c-957a-cf80120a0f72 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.995679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b52b01-3310-4507-85d9-4d7e68050ec2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:58.995919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:58.996534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:58.996812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:58.997086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:58.997728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:58.999375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.000281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4b8be-0e7d-4415-8a5d-959b553b0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.000885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b8be-0e7d-4415-8a5d-959b553b0c52 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.001166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b8be-0e7d-4415-8a5d-959b553b0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.001433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b8be-0e7d-4415-8a5d-959b553b0c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.002053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4b8be-0e7d-4415-8a5d-959b553b0c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.003970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4b8be-0e7d-4415-8a5d-959b553b0c52 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.009476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 793/1578] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.010392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.020432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea080046-8b8e-4839-a906-8df90da1e580 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.025566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.026154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.026433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.027498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.028533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.030225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.093248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 786/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:51:58 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:59.094679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.095061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.095296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.104005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 794/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:59.108185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.114569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:59.115784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:59.118766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dad47-ff87-4d07-b9a3-2e9a00e61c41 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.175017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.175623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.175903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.176197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.176565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 787/1581] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:59.176823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.177393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.178874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.187211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b53ac-21f1-4eff-9f01-5f01bbbc3c30 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.191766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.192363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.192637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.192901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.193529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.195182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.205720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 788/1582] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.206595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.216619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf0534-9e86-4700-ae20-c05a7e6b80e7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.221268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.221872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.222154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.222444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.223090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.225114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.237438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 795/1583] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:59.237438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.240680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:59.246029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ea9e8-1eca-4612-a7fa-88be826e22b5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.250763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.251423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.251702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.251970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.252631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.254937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.314359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:59.319797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 796/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/users => generated 283 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:59.323633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.323843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 789/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:59.325028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.335260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510eebd-0d92-404e-8010-596dac1cbaf7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.337170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9273ec4-75ca-415b-b360-5a8924dab670 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.340276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.340861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.341136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.341405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.342027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.342867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.343540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.343819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.343960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.344091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] PATH_INFO: `/v3/projects/c41ee9a31d894ff7bba265021cdca4fa/users/bbb87e23742c4fc99931477bce020e10/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.359540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41ee9a31d894ff7bba265021cdca4fa, user_id=bbb87e23742c4fc99931477bce020e10, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.362384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.421866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 790/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:51:59.422721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.428714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 797/1587] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:51:59 2022] PUT /identity/v3/projects/c41ee9a31d894ff7bba265021cdca4fa/users/bbb87e23742c4fc99931477bce020e10/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:51:59.429189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.434447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866170ba-6ff8-4149-be6f-57ebe3f545d5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.489609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116528d-7fd1-4bd2-a971-70486559bc6a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.493418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.494054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.494348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.494647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.494886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.495602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.495876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.496172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.496779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.498410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.504601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.506130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.508950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 791/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.509766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.519309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 798/1589] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:51:59.520201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.520309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e81219-5863-495c-8cdf-3959ee12241a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.525216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.525820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.526099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.526376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.527818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.529672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.531329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db01cf-4ef2-433d-a326-5a7d659681c6 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.541411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 792/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.541685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.542331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.542532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.542909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.543248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.547964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.547964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.557775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 799/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.559223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.562218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93749-918e-4b7b-bb74-a9ac7ac49bff admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.568534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.569230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.569517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.569649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006011-2c67-48b2-99d4-6459e77cb096 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.569794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.570437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.572077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.575059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e39dd2-d6be-414f-9515-a3dc419c79d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.576048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39dd2-d6be-414f-9515-a3dc419c79d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.576325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39dd2-d6be-414f-9515-a3dc419c79d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.576596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e39dd2-d6be-414f-9515-a3dc419c79d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.577229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39dd2-d6be-414f-9515-a3dc419c79d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.578835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e39dd2-d6be-414f-9515-a3dc419c79d5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.584519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 793/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.588002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.593548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 800/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.593548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.593548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.593548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.599177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec7a37-e7b0-42c4-b884-35fe2e2b73fe admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.603912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.604593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.605381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.605765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.606537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.608177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.616802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:51:59.618615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 794/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.618770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:51:59.619532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.628505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 801/1595] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:51:59.629321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.633445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6806-8f71-40a8-8054-cce912e840e5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.638795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.639994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.639994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.639994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.640611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.641131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b827e-2e69-45c9-8418-de59ee5d185d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.642832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.648403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.649164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.649376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.649711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] PATH_INFO: `/v3/projects/8699604d52874cda8ff8c3c7b8e23345/users/2dc650cb1f194ae5a40ac77e02f267a2/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.653343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 795/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.656793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.669439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8699604d52874cda8ff8c3c7b8e23345, user_id=2dc650cb1f194ae5a40ac77e02f267a2, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.671134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4a57-bef7-4ee2-a0bb-2e59b95d2cd8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.672264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.676118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.679384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.679384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.679384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.679384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.679740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.690839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 796/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.691384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.701689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37ecbe-1476-4f06-9d46-3f4d89a4ebd1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.706316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.706933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.707207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.707472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.708096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.709728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.724285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 797/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.724285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.731748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749457-51e6-49d8-87fd-dd857b352312 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.736358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 802/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:51:59 2022] PUT /identity/v3/projects/8699604d52874cda8ff8c3c7b8e23345/users/2dc650cb1f194ae5a40ac77e02f267a2/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:51:59.744905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.809052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.811317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.811317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.811317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.811556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.813412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.826270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546037aa-e1aa-4aee-a1ea-f533e2d1ad45 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.827200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 798/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.827200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.831755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.832685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.832965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.833445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.834403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.837208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.841755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:59.855869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 803/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:51:59.855869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.868392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b0b6-6efb-432a-8e1e-2993fbdfee6d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.875375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.876048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.876323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.876856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] PATH_INFO: `/v3/projects/136e678f9f9646189d30e3f6f13bf9d4/users/a971c45716224f4b8ca7e527516babcb/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.880360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:51:59.898300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136e678f9f9646189d30e3f6f13bf9d4, user_id=a971c45716224f4b8ca7e527516babcb, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.902020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.915609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f60e-5946-4c27-a059-427314460410 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.921344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.922584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.925330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.925330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.937263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.949171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:51:59.959280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 799/1602] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:51:59.960110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.969403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210013fb-5e12-4e22-be33-929807b593d6 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:51:59.974344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac39829-aaf8-4192-9590-9f9b7425578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:51:59.975034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac39829-aaf8-4192-9590-9f9b7425578f admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:51:59.975369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac39829-aaf8-4192-9590-9f9b7425578f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:51:59.975649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac39829-aaf8-4192-9590-9f9b7425578f admin admin] PATH_INFO: `/v3/projects/a0b4c5e4437a4b259e635c171d3740e7/users/d9c44ff7553443219e20877119582514/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:51:59.981417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 804/1603] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:51:59 2022] PUT /identity/v3/projects/136e678f9f9646189d30e3f6f13bf9d4/users/a971c45716224f4b8ca7e527516babcb/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:51:59.982598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:51:59.994756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac39829-aaf8-4192-9590-9f9b7425578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b4c5e4437a4b259e635c171d3740e7, user_id=d9c44ff7553443219e20877119582514, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:51:59.998185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac39829-aaf8-4192-9590-9f9b7425578f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.051600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8c836-1b4e-4c3b-961e-9080e49ace38 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.056769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.057460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.057741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.058706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] PATH_INFO: `/v3/projects/519cb9138f844cd2bbef41d5ce3a22dc/users/9c484bca84d84d14bac902302ff49ddc/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.074791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519cb9138f844cd2bbef41d5ce3a22dc, user_id=9c484bca84d84d14bac902302ff49ddc, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.077508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.105807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 800/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:51:59 2022] PUT /identity/v3/projects/a0b4c5e4437a4b259e635c171d3740e7/users/d9c44ff7553443219e20877119582514/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:00.107037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.107217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.107642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.135231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.137106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:00.182429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 805/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:51:59 2022] PUT /identity/v3/projects/519cb9138f844cd2bbef41d5ce3a22dc/users/9c484bca84d84d14bac902302ff49ddc/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:00.183270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.221809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 801/1606] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:00.226843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.238595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c12a0-a764-4572-920f-e71f22990a18 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.258429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8fcf1-58b0-4a98-a936-701203774d30 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.265094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9994051-6ec0-46c0-b207-508745ce2d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.265988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9994051-6ec0-46c0-b207-508745ce2d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.266429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9994051-6ec0-46c0-b207-508745ce2d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.266899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9994051-6ec0-46c0-b207-508745ce2d77 admin admin] PATH_INFO: `/v3/projects/682cba1c702447d487152bfed740f1d8/users/0b632f0be1ea46278a685170f899219f/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.287439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9994051-6ec0-46c0-b207-508745ce2d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682cba1c702447d487152bfed740f1d8, user_id=0b632f0be1ea46278a685170f899219f, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.290436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9994051-6ec0-46c0-b207-508745ce2d77 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.307275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891301b-b414-4de3-9168-c278385a517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.309761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891301b-b414-4de3-9168-c278385a517e admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.309761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891301b-b414-4de3-9168-c278385a517e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.309761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891301b-b414-4de3-9168-c278385a517e admin admin] PATH_INFO: `/v3/projects/ef9e0f5a3e3a423fbd778a6218543a20/users/d12e9c1e41264150b70ab2cf08c78b1b/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.328013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891301b-b414-4de3-9168-c278385a517e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9e0f5a3e3a423fbd778a6218543a20, user_id=d12e9c1e41264150b70ab2cf08c78b1b, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.331193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891301b-b414-4de3-9168-c278385a517e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.373141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 806/1607] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:00 2022] PUT /identity/v3/projects/682cba1c702447d487152bfed740f1d8/users/0b632f0be1ea46278a685170f899219f/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:00.377989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a5a9-9f14-490a-970b-edad1217beef None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.378277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a5a9-9f14-490a-970b-edad1217beef None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.378589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a5a9-9f14-490a-970b-edad1217beef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.410307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0ef7a5a9-9f14-490a-970b-edad1217beef None None] MFA Rules not processed for user `a971c45716224f4b8ca7e527516babcb`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.411549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0ef7a5a9-9f14-490a-970b-edad1217beef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:00.412865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 802/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:00 2022] PUT /identity/v3/projects/ef9e0f5a3e3a423fbd778a6218543a20/users/d12e9c1e41264150b70ab2cf08c78b1b/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:00.414336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.414661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.414937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.437905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:00.445989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] MFA Rules not processed for user `d9c44ff7553443219e20877119582514`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.447214 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:00.452960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:00.478232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 807/1609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:00.484427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019326a9-6164-4fd6-9240-526db48038e1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.484712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019326a9-6164-4fd6-9240-526db48038e1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.484983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019326a9-6164-4fd6-9240-526db48038e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.516064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-019326a9-6164-4fd6-9240-526db48038e1 None None] MFA Rules not processed for user `9c484bca84d84d14bac902302ff49ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.517440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-019326a9-6164-4fd6-9240-526db48038e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:00.546623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 803/1610] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:00.546623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.633454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 808/1611] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:00.634863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327a31-fa8a-48c2-9720-66f6e9debdfc None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.635152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327a31-fa8a-48c2-9720-66f6e9debdfc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.635428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55327a31-fa8a-48c2-9720-66f6e9debdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.653896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2c240-0cee-4493-8791-5bdd9dd19622 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.659758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b9da7-ddce-4bff-a064-e92a4333dc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.660803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b9da7-ddce-4bff-a064-e92a4333dc84 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.661086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b9da7-ddce-4bff-a064-e92a4333dc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.661413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b9da7-ddce-4bff-a064-e92a4333dc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.663629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-55327a31-fa8a-48c2-9720-66f6e9debdfc None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.665455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-55327a31-fa8a-48c2-9720-66f6e9debdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:00.730344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b9da7-ddce-4bff-a064-e92a4333dc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.731936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b9da7-ddce-4bff-a064-e92a4333dc84 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.732319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 809/1612] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:00.733745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.734166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.734937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.744905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 804/1613] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:00.747119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a71c4-4b34-4495-91b9-dc957b14be0d None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.747412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a71c4-4b34-4495-91b9-dc957b14be0d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.747692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a71c4-4b34-4495-91b9-dc957b14be0d None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.749268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 805/1614] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 14 02:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:00.750055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a71c4-4b34-4495-91b9-dc957b14be0d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.758065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.759718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:00.775818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 810/1615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:00.775818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.795639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f008b-320c-44bb-b615-39df8c1278a9 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.801427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b63e42-532e-4e2e-8d07-bf3cfc1e384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.802072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b63e42-532e-4e2e-8d07-bf3cfc1e384b admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.802357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b63e42-532e-4e2e-8d07-bf3cfc1e384b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.802664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b63e42-532e-4e2e-8d07-bf3cfc1e384b admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.803305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b63e42-532e-4e2e-8d07-bf3cfc1e384b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.805503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b63e42-532e-4e2e-8d07-bf3cfc1e384b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.825571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a71c4-4b34-4495-91b9-dc957b14be0d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.829422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.843607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.844249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.850325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.854202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:00.857966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.859657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.871002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 806/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:00.873022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.882978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1a829-1bed-4393-8763-351510b4828d service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.890808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:00.891727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.893036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.893486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.900970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 811/1617] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:00.905546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:00.905800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:00.906073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:00.910364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:00.911856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:00.923613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 807/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:00.924896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:00.943649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ac08f-f20e-4fd7-8750-46474421e206 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:00.973606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:00.987188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:01.033339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:01.037156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.038528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.038957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.039550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.151341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.160479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.190550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 808/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:01.191398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:01.197101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 812/1620] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 14 02:52:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:01.208073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:01.213531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0359ee-c919-4118-999d-43fe3fc57665 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:01.226833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.227469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.227765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.228528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.229176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.233736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004158d7-66ae-48ff-a2f1-ed4112250581 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:01.246010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.251381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.252788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.253500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.253930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.334198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 809/1621] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:01 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:01.342960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:01.356264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61fe35-2e28-479d-bc18-7b103e3170df admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:01.364551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.367233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.367629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.368003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.381433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.383990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.413839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 810/1622] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:01.419073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:01.443662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affcb76-0dd8-42fe-a091-a6542a87337e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:01.452612 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.454406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.457927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.458760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.459142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.459516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] PATH_INFO: `/v3/projects/2f62f585eaa54e3fbc70c3b93d77e705/users/ac2a5cacddd04babb5e26262738872b6/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.466688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 813/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:01.547599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f62f585eaa54e3fbc70c3b93d77e705, user_id=ac2a5cacddd04babb5e26262738872b6, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.550685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.658806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 811/1624] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:01 2022] PUT /identity/v3/projects/2f62f585eaa54e3fbc70c3b93d77e705/users/ac2a5cacddd04babb5e26262738872b6/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:01.665248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:01.681690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fbbbf-5f8d-4bbe-abbd-a44ca29b5827 service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:01.822391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de453465-e170-4557-aea8-566a5f72c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.823269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453465-e170-4557-aea8-566a5f72c84d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.823778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453465-e170-4557-aea8-566a5f72c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.824133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de453465-e170-4557-aea8-566a5f72c84d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.825005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de453465-e170-4557-aea8-566a5f72c84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.827069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de453465-e170-4557-aea8-566a5f72c84d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.861483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 814/1625] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:01.862583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:01.876993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f90e2-5bf3-48d0-a3a5-19fc0f93502c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:01.893592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513e52-744b-47f1-9ffa-9502dd920f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:01.894287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513e52-744b-47f1-9ffa-9502dd920f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.894607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513e52-744b-47f1-9ffa-9502dd920f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.894881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513e52-744b-47f1-9ffa-9502dd920f96 admin admin] PATH_INFO: `/v3/projects/2f62f585eaa54e3fbc70c3b93d77e705/users/ac2a5cacddd04babb5e26262738872b6/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.902546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc513e52-744b-47f1-9ffa-9502dd920f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f62f585eaa54e3fbc70c3b93d77e705, user_id=ac2a5cacddd04babb5e26262738872b6, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:01.909493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc513e52-744b-47f1-9ffa-9502dd920f96 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:01.945538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 812/1626] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:01 2022] PUT /identity/v3/projects/2f62f585eaa54e3fbc70c3b93d77e705/users/ac2a5cacddd04babb5e26262738872b6/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:01.961087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.961472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.961824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.966991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2f91b-341f-4530-a9b1-d75231d13fe7 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.974485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2f91b-341f-4530-a9b1-d75231d13fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.974485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2f91b-341f-4530-a9b1-d75231d13fe7 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:01.979726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 813/1627] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 14 02:52:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:01.987447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:01.987447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:01.987447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:02.043432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:02.046746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:02.048361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] MFA Rules not processed for user `ac2a5cacddd04babb5e26262738872b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:02.050610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:02.118431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:02.136968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:02.195662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 815/1628] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:02.212640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:02.289205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 814/1629] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:52:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:02.348514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d603b-bf5a-44c4-b215-001816c7e2be None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:02.360088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:02.361542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:02.361693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:02.362081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:02.385038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:02.402430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:02.439035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:02.452029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1166d1-7947-4d3e-af36-7b3036c5c583 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:02.462303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c188e60-7c25-4fc0-a392-6afcc5a0b958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:02.463789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188e60-7c25-4fc0-a392-6afcc5a0b958 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:02.465097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188e60-7c25-4fc0-a392-6afcc5a0b958 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:02.465547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188e60-7c25-4fc0-a392-6afcc5a0b958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:02.473529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 816/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:02.508004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c188e60-7c25-4fc0-a392-6afcc5a0b958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:02.509473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c188e60-7c25-4fc0-a392-6afcc5a0b958 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:02.530573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 815/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:04.097534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:04.161259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fda90-a77e-41b9-affa-2249f3d1c4ab None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.162500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fda90-a77e-41b9-affa-2249f3d1c4ab None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.163554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fda90-a77e-41b9-affa-2249f3d1c4ab None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.165827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 816/1632] 10.222.0.27 () {54 vars in 962 bytes} [Wed Sep 14 02:52:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:04.174108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab535b5-f13d-4fe8-b3d3-64a7f7cc2b5d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.174673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab535b5-f13d-4fe8-b3d3-64a7f7cc2b5d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.175109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab535b5-f13d-4fe8-b3d3-64a7f7cc2b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.220570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0ab535b5-f13d-4fe8-b3d3-64a7f7cc2b5d None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:04.226056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0ab535b5-f13d-4fe8-b3d3-64a7f7cc2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:04.256671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 817/1633] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Sep 14 02:52:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:04.262638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3423643-8077-45b4-bb93-4fc53da672bb None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.263141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3423643-8077-45b4-bb93-4fc53da672bb None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.263571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3423643-8077-45b4-bb93-4fc53da672bb None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.268730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 818/1634] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 14 02:52:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:52:04.274497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.275001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.275706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.280314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a9d86-2e84-4b7d-9f8f-7b86fa620cef service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:04.294291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:04.295220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.297154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.297621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] PATH_INFO: `/v3/users/9c484bca84d84d14bac902302ff49ddc` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.303315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c484bca84d84d14bac902302ff49ddc)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:04.308769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:04.334548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:04.339639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:04.373826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 819/1635] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:52:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:04.389560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:04.401457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c020c-d3a8-4aaa-ae9e-a01d65821440 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:04.406651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c519bb-2681-42f5-bfa1-f55337fa196d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:04.407361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c519bb-2681-42f5-bfa1-f55337fa196d service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.407694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c519bb-2681-42f5-bfa1-f55337fa196d service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.408359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c519bb-2681-42f5-bfa1-f55337fa196d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.421925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c519bb-2681-42f5-bfa1-f55337fa196d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:04.423551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c519bb-2681-42f5-bfa1-f55337fa196d service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:04.448166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 820/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:04.651864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c484bca84d84d14bac902302ff49ddc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:04.777349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c484bca84d84d14bac902302ff49ddc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:04.778399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c484bca84d84d14bac902302ff49ddc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:04.780483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c484bca84d84d14bac902302ff49ddc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:04.799324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c484bca84d84d14bac902302ff49ddc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:04.840435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:04.888253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 817/1637] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:04 2022] DELETE /identity/v3/users/9c484bca84d84d14bac902302ff49ddc => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:04.890436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:04.890919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:04.891302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:04.952729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:04.957393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:05.180536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 821/1638] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:05.195705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:05.197393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:05.339752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64506500-07a2-461a-8e12-13bbcf62a066 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:05.344954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:05.345892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:05.346458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:05.347005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:05.365780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:05.368543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:05.384098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 818/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:06.721103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:06.723141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:06.755622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4e283-c960-4339-88aa-8a10b7085684 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:06.775651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:06.776340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:06.776758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:06.777162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] PATH_INFO: `/v3/projects/519cb9138f844cd2bbef41d5ce3a22dc` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:06.780640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519cb9138f844cd2bbef41d5ce3a22dc)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:06.784101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:07.049101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519cb9138f844cd2bbef41d5ce3a22dc', 'request_id': 'req-ea9afec7-471f-44b4-81d9-2f047cf60ec0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.067449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519cb9138f844cd2bbef41d5ce3a22dc', 'request_id': 'req-ea9afec7-471f-44b4-81d9-2f047cf60ec0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.130740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519cb9138f844cd2bbef41d5ce3a22dc', 'request_id': 'req-ea9afec7-471f-44b4-81d9-2f047cf60ec0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.148097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:07.152670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] The token cache is being invalidate because project 519cb9138f844cd2bbef41d5ce3a22dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:07.153119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.153973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.156030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 822/1640] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:06 2022] DELETE /identity/v3/projects/519cb9138f844cd2bbef41d5ce3a22dc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:07.168675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:07.220539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adbdb3-fd8a-4853-b279-595d3110a0e4 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:07.445427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:07.446662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:07.446864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:07.447136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] PATH_INFO: `/v3/users/ac2a5cacddd04babb5e26262738872b6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:07.452863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2a5cacddd04babb5e26262738872b6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:07.455531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:07.675123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2a5cacddd04babb5e26262738872b6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.764816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2a5cacddd04babb5e26262738872b6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.770618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2a5cacddd04babb5e26262738872b6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.774162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2a5cacddd04babb5e26262738872b6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.786767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42dd2ee5-e1d0-41a0-8124-45efff457f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2a5cacddd04babb5e26262738872b6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:07.869318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 819/1641] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:07 2022] DELETE /identity/v3/users/ac2a5cacddd04babb5e26262738872b6 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:09.927784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:09.929321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:09.950330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9afec7-471f-44b4-81d9-2f047cf60ec0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:10.086738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:10.088248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:10.088736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:10.089362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] PATH_INFO: `/v3/projects/2f62f585eaa54e3fbc70c3b93d77e705` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:10.092285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f62f585eaa54e3fbc70c3b93d77e705)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:10.106974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:10.291099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f62f585eaa54e3fbc70c3b93d77e705', 'request_id': 'req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:10.304475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f62f585eaa54e3fbc70c3b93d77e705', 'request_id': 'req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:10.381947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f62f585eaa54e3fbc70c3b93d77e705', 'request_id': 'req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:10.399953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] The token cache is being invalidate because project 2f62f585eaa54e3fbc70c3b93d77e705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:10.400548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:10.403196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:10.406304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 823/1642] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:09 2022] DELETE /identity/v3/projects/2f62f585eaa54e3fbc70c3b93d77e705 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:10.411455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2c0f-7565-4b2c-bd5f-d448fb10b02d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:10.414547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2c0f-7565-4b2c-bd5f-d448fb10b02d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:10.414547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2c0f-7565-4b2c-bd5f-d448fb10b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:10.461372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-bb5d2c0f-7565-4b2c-bd5f-d448fb10b02d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:10.465534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bb5d2c0f-7565-4b2c-bd5f-d448fb10b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:10.511433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:10.645752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:10.647704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:10.669277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d3e6-6755-4e32-8bc2-c39cbd3d30ce admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:10.680436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 820/1643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:10.687803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:10.688461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:10.688738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:10.689061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] PATH_INFO: `/v3/users/a971c45716224f4b8ca7e527516babcb` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:10.691037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:10.691662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:10.692130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:10.694389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a971c45716224f4b8ca7e527516babcb)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:10.695518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: WARNING py.warnings [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:52:10.695518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: warnings.warn(msg) Sep 14 02:52:10.695518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: Sep 14 02:52:10.697614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:10.754344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:10.755617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:10.793617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 821/1644] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:10.797852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:10.829442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcda2-c46f-40b2-bdcc-0f66261a5eae None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:10.845957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:10.846689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:10.846905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:10.847173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:10.847822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:10.848124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:10.858197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:10.935597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 822/1645] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:10.936092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:10.952551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd316-6f72-419c-b05d-1e11dc5160b0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:10.965219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:10.966346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:10.966346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:10.966346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:10.967110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:10.981715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:11.044933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a971c45716224f4b8ca7e527516babcb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:11.046203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a971c45716224f4b8ca7e527516babcb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:11.077736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 823/1646] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:10 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:11.083829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:11.107685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a971c45716224f4b8ca7e527516babcb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:11.108340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a971c45716224f4b8ca7e527516babcb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:11.195944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-672997bb-5f75-4290-b16f-58c147f5163e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a971c45716224f4b8ca7e527516babcb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:11.242195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 824/1647] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:10 2022] DELETE /identity/v3/users/a971c45716224f4b8ca7e527516babcb => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:11.244022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.244499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.244929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.263139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:11.276177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702be7d-7ada-48b8-adf3-1f4226b1ed5f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:11.293203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:11.295033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:11.422110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555851c-ccc2-44aa-9c75-95a9ffac1dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:11.425822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555851c-ccc2-44aa-9c75-95a9ffac1dfa admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.426316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555851c-ccc2-44aa-9c75-95a9ffac1dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.427146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555851c-ccc2-44aa-9c75-95a9ffac1dfa admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.429307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555851c-ccc2-44aa-9c75-95a9ffac1dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:11.433148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555851c-ccc2-44aa-9c75-95a9ffac1dfa admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:11.433700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 825/1648] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:11.461485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:11.467612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:11.560586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 824/1649] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:11 2022] POST /identity/v3/users => generated 283 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:11.561977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.562270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.562571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.617574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffef14-e480-4d0e-ad45-5ccb07e5e0e6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:11.627045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:11.627611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.627894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.628170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.641152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] MFA Rules not processed for user `bbb87e23742c4fc99931477bce020e10`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:11.645227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:11.660083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:11.666053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:11.666053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:11.691911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 826/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:11.692790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:11.694126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:11.718297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80034e1f-3de5-4a5b-b466-21e87c83270c service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:11.728940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:11.730118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.730439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.730960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.731781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:11.733422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:11.766175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 827/1651] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:11.771207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:11.786385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f8f1-6e9e-46f1-9077-9ca0a5912155 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:11.800069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:11.800697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.800976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.801309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.802046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:11.805584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:11.825261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 825/1652] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:11.828763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 828/1653] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:11.834304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:11.837403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:11.839937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:11.873678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce5b5-64d6-46ef-834a-186ea1efb3f9 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:11.917885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597e77-7d6d-4e1c-beeb-502d4418ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:11.922710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597e77-7d6d-4e1c-beeb-502d4418ab1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:11.923008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597e77-7d6d-4e1c-beeb-502d4418ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:11.923356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597e77-7d6d-4e1c-beeb-502d4418ab1c admin admin] PATH_INFO: `/v3/projects/50b0dc9e7c054761939ec77c62c5cf45/users/ae3324d98fc84479b705c03e5fff0226/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:11.999043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597e77-7d6d-4e1c-beeb-502d4418ab1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b0dc9e7c054761939ec77c62c5cf45, user_id=ae3324d98fc84479b705c03e5fff0226, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:12.006795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597e77-7d6d-4e1c-beeb-502d4418ab1c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:12.081479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2983-8b8f-4cad-ac19-271dff3d1863 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:12.098418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:12.099148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:12.099428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:12.099701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:12.119748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 826/1654] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:11 2022] PUT /identity/v3/projects/50b0dc9e7c054761939ec77c62c5cf45/users/ae3324d98fc84479b705c03e5fff0226/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:12.121676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:12.121970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:12.122245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:12.140673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:12.143527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:12.210353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 829/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:12.231804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] MFA Rules not processed for user `ae3324d98fc84479b705c03e5fff0226`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:12.241519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:12.555760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 827/1656] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:12.561315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:12.575821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf32dd-140c-4dab-b226-dc0f3f2bb898 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:12.601925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:12.790487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:12.793404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:12.793817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:12.794832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:12.796171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:12.800156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:12.903023 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 830/1657] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:12 2022] POST /identity/v3/projects => generated 363 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:12.905605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:12.929688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680eef4-6d7b-4fe9-9246-fb424123f976 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:13.067884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:13.068509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:13.068847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:13.069064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:13.070786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:13.071704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:13.169117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 828/1658] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:12 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:13.171689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:13.189144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc773-8830-453d-8800-f1924e97491d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:13.210798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:13.211535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:13.211885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:13.212228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:13.212994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:13.215794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:13.232778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 831/1659] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:13.239171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:13.246850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:13.255658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875dde5-27fa-4631-92ae-7aa4531d1947 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:13.263421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:13.264415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:13.264922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:13.265489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] PATH_INFO: `/v3/projects/0c2cfe8e4efd497d9a5fb8f8f4c902cf/users/3be8eb0c41714e289ee0490da780a5f4/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:13.289998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2cfe8e4efd497d9a5fb8f8f4c902cf, user_id=3be8eb0c41714e289ee0490da780a5f4, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:13.293618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:13.390865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:13.391930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 829/1660] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:13 2022] PUT /identity/v3/projects/0c2cfe8e4efd497d9a5fb8f8f4c902cf/users/3be8eb0c41714e289ee0490da780a5f4/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:13.409920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88e567-4f44-493a-888c-7ac081a26845 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:13.523685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487371b-2af5-4a7c-9950-a20b9929d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:13.524388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487371b-2af5-4a7c-9950-a20b9929d6da admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:13.524831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487371b-2af5-4a7c-9950-a20b9929d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:13.529040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487371b-2af5-4a7c-9950-a20b9929d6da admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:13.529040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487371b-2af5-4a7c-9950-a20b9929d6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:13.529864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487371b-2af5-4a7c-9950-a20b9929d6da admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:13.540924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 832/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:13.545762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:13.560435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab026b6-fb89-452e-9f47-caf55f29b60b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:13.569779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:13.572972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:13.572972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:13.573368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] PATH_INFO: `/v3/projects/0c2cfe8e4efd497d9a5fb8f8f4c902cf/users/3be8eb0c41714e289ee0490da780a5f4/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:13.580035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2cfe8e4efd497d9a5fb8f8f4c902cf, user_id=3be8eb0c41714e289ee0490da780a5f4, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:13.582761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:13.609816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:13.610108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:13.610438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:13.617724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 830/1662] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:13 2022] PUT /identity/v3/projects/0c2cfe8e4efd497d9a5fb8f8f4c902cf/users/3be8eb0c41714e289ee0490da780a5f4/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:13.653066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] MFA Rules not processed for user `3be8eb0c41714e289ee0490da780a5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:13.654361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:13.827428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 833/1663] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:13.841323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:13.842756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:13.975656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:13.977139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:13.985501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:14.010435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02280e-a039-45c0-8fdd-c3cff2b71578 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:14.021820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a1cec-c996-4597-918c-2ccce1d27cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:14.023896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a1cec-c996-4597-918c-2ccce1d27cca service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:14.060721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a1cec-c996-4597-918c-2ccce1d27cca service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:14.061904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a1cec-c996-4597-918c-2ccce1d27cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:14.149226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a1cec-c996-4597-918c-2ccce1d27cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:14.153845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58953e-a8b8-4db5-a822-6c147fa3e0c4 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:14.156588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a1cec-c996-4597-918c-2ccce1d27cca service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:14.164385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:14.164672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:14.164952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:14.165225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] PATH_INFO: `/v3/projects/136e678f9f9646189d30e3f6f13bf9d4` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:14.166489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=136e678f9f9646189d30e3f6f13bf9d4)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:14.169183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:14.186726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 831/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:14.350167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136e678f9f9646189d30e3f6f13bf9d4', 'request_id': 'req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:14.373066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136e678f9f9646189d30e3f6f13bf9d4', 'request_id': 'req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:14.473812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136e678f9f9646189d30e3f6f13bf9d4', 'request_id': 'req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:14.493303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] The token cache is being invalidate because project 136e678f9f9646189d30e3f6f13bf9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:14.493832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:14.494934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:14.501276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 834/1665] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:13 2022] DELETE /identity/v3/projects/136e678f9f9646189d30e3f6f13bf9d4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:14.507194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f904-bf5d-4705-bd80-d1f27288281b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:14.507491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f904-bf5d-4705-bd80-d1f27288281b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:14.507772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f904-bf5d-4705-bd80-d1f27288281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:14.536604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:14.538067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:14.567831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-acc0f904-bf5d-4705-bd80-d1f27288281b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:14.583102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-acc0f904-bf5d-4705-bd80-d1f27288281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:14.696191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e750e9-6540-4259-bd09-fc0ab7e1e9ee admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:14.705802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:14.709053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:14.709608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:14.711094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:14.716891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:14.736140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 832/1666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:14.739962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:14.740363 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:14.741998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:14.829575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] MFA Rules not processed for user `a4cd49cba5ac42a999f95733cc3a466c`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:14.834876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:14.864216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:14.866486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b77218-cd49-47a1-97b8-04616e80084c service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:14.891924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 835/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:14.896651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:14.896944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:14.897224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:14.942819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:14.943791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:14.959874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:14.963008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 836/1668] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:14.967671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:14.972568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:14.977222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 833/1669] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:14.991940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:14.993749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:14.996986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca704-54d5-49d6-bbff-cf1e4be71166 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.006865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.007715 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.008762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.009088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.010375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:15.010667 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.013119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:15.040792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 837/1670] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:15.045388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:15.057221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16f86-1087-4c97-bce9-96f502cf4be5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.072579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.073380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.073833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.074183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.074925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.077441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:15.175876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ceb9a-86e2-478d-b21a-8f6c1c3e2929 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.190364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.191026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.191312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.191577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.208353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.213189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:15.245295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 838/1671] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:15 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:52:15.249502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:15.261956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 834/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:15.522396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5111c6c-8bd3-46a2-b90a-b951cc3a60ae admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.538087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.538765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.539043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.539307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.539950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.542108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:15.673307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 839/1673] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:15 2022] POST /identity/v3/users => generated 287 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:15.674715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:15.693078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da35aa2-2be9-4ce5-99f4-c4b47242cdbf service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.710289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.711026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.711473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.711806 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.712464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.719984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:15.758250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 835/1674] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:15.762708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:15.785487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908b540-96fe-44b9-865f-06b56c1c6674 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.796567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57277ca0-b73b-46dc-bad5-0793d42a3b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.797261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277ca0-b73b-46dc-bad5-0793d42a3b7f admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.797586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277ca0-b73b-46dc-bad5-0793d42a3b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.797990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57277ca0-b73b-46dc-bad5-0793d42a3b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.799398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277ca0-b73b-46dc-bad5-0793d42a3b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.803145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57277ca0-b73b-46dc-bad5-0793d42a3b7f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:15.833796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 840/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:15.838297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:15.862515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e738a-88cc-4849-9542-5879c0564857 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:15.873933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:15.874835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:15.877814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:15.877814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] PATH_INFO: `/v3/projects/a09b0990492f43758fbcaac845d01604/users/aecfef75cddf44c1a581ab7b2ffa868b/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:15.924877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09b0990492f43758fbcaac845d01604, user_id=aecfef75cddf44c1a581ab7b2ffa868b, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:15.935145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:16.020352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 836/1676] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:15 2022] PUT /identity/v3/projects/a09b0990492f43758fbcaac845d01604/users/aecfef75cddf44c1a581ab7b2ffa868b/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:16.032671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:16.033881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:16.034408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:16.127943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] MFA Rules not processed for user `aecfef75cddf44c1a581ab7b2ffa868b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:16.130734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:16.291233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 841/1677] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:16.299667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:16.301988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:16.311482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:16.320377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:16.484381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35787b-caba-4e79-a6f9-52ed43160426 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:16.498388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:16.499193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:16.499559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:16.499902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] PATH_INFO: `/v3/users/d9c44ff7553443219e20877119582514` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:16.501710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c44ff7553443219e20877119582514)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:16.504219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:16.550059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed382-aa20-47ab-a40d-89914c4986b5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:16.571592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34a185-102e-48ab-8564-dd3c8e940f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:16.572241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34a185-102e-48ab-8564-dd3c8e940f40 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:16.572800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34a185-102e-48ab-8564-dd3c8e940f40 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:16.573084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34a185-102e-48ab-8564-dd3c8e940f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:16.599429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34a185-102e-48ab-8564-dd3c8e940f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:16.601055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34a185-102e-48ab-8564-dd3c8e940f40 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:16.627112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 837/1678] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:16.691225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c44ff7553443219e20877119582514'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:16.693014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c44ff7553443219e20877119582514'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:16.764876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c44ff7553443219e20877119582514'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:16.765528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c44ff7553443219e20877119582514'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:16.776756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:16.793821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c44ff7553443219e20877119582514'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:16.836103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 842/1679] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:16 2022] DELETE /identity/v3/users/d9c44ff7553443219e20877119582514 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:16.837526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186fa95-79f8-4a2a-a614-78a55a55f565 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:16.837956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186fa95-79f8-4a2a-a614-78a55a55f565 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:16.838100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186fa95-79f8-4a2a-a614-78a55a55f565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:16.897794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8186fa95-79f8-4a2a-a614-78a55a55f565 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:16.915222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8186fa95-79f8-4a2a-a614-78a55a55f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:17.026514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:17.120959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 838/1680] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:52:17.189972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:17.192178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:17.362614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2106a1f-2975-432e-9438-1b21e6ef273b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:17.368317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45b502-5072-443d-8942-fdd4eee92483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:17.369218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b502-5072-443d-8942-fdd4eee92483 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:17.369640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b502-5072-443d-8942-fdd4eee92483 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:17.370835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45b502-5072-443d-8942-fdd4eee92483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:17.384394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45b502-5072-443d-8942-fdd4eee92483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:17.387016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45b502-5072-443d-8942-fdd4eee92483 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:17.399644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 843/1681] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:17.984831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4e5a-d521-4697-9ed6-c69505bda1ad None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:17.985415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4e5a-d521-4697-9ed6-c69505bda1ad None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:17.985717 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4e5a-d521-4697-9ed6-c69505bda1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:18.025161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a10f4e5a-d521-4697-9ed6-c69505bda1ad None None] MFA Rules not processed for user `bbb87e23742c4fc99931477bce020e10`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:18.029532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a10f4e5a-d521-4697-9ed6-c69505bda1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:18.219412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 839/1682] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:19.592132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e36bb-6d27-4e8b-bcfa-6d5287bbd75b None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:19.592674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e36bb-6d27-4e8b-bcfa-6d5287bbd75b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:19.593002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e36bb-6d27-4e8b-bcfa-6d5287bbd75b None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:19.595113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 844/1683] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 14 02:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:19.639550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:19.640506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:19.640940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:19.774243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:19.777378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:19.791632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 840/1684] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:52:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:19.806020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e36bb-6d27-4e8b-bcfa-6d5287bbd75b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:19.808364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-012e36bb-6d27-4e8b-bcfa-6d5287bbd75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:19.853694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e36bb-6d27-4e8b-bcfa-6d5287bbd75b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:19.861815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:19.862842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:19.863358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:19.863851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:19.877389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:19.879721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:19.881187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:19.881744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:19.894604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 845/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:19.918440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb72e6-73a1-4f5f-a9b3-79c42065f7ac None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:19.928595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:19.930892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:19.934381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:19.945505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] PATH_INFO: `/v3/users/ae3324d98fc84479b705c03e5fff0226` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:19.945505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3324d98fc84479b705c03e5fff0226)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:19.949921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:19.954248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:19.956933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:20.017357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a7c0b-39ae-4ad4-94c2-4386d1ec959b service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:20.036600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:20.037297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:20.037581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:20.038392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] PATH_INFO: `/v3/projects/a0b4c5e4437a4b259e635c171d3740e7` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:20.052400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b4c5e4437a4b259e635c171d3740e7)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:20.054993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:20.128058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:20.225222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3324d98fc84479b705c03e5fff0226'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.259485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b4c5e4437a4b259e635c171d3740e7', 'request_id': 'req-4a5266a3-9013-4102-a27d-27407a68e2b2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.272833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b4c5e4437a4b259e635c171d3740e7', 'request_id': 'req-4a5266a3-9013-4102-a27d-27407a68e2b2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.358989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3324d98fc84479b705c03e5fff0226'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.359830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3324d98fc84479b705c03e5fff0226'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.360915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3324d98fc84479b705c03e5fff0226'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.375620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-20429db5-f5e6-440c-9c5c-072770ac783e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3324d98fc84479b705c03e5fff0226'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.423018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 841/1686] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:19 2022] DELETE /identity/v3/users/ae3324d98fc84479b705c03e5fff0226 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:20.427911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:20.428196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:20.430712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:20.468966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b4c5e4437a4b259e635c171d3740e7', 'request_id': 'req-4a5266a3-9013-4102-a27d-27407a68e2b2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.487637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] The token cache is being invalidate because project a0b4c5e4437a4b259e635c171d3740e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:20.489315 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:20.495733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.495861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:20.495950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4a5266a3-9013-4102-a27d-27407a68e2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:20.495950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 846/1687] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:19 2022] DELETE /identity/v3/projects/a0b4c5e4437a4b259e635c171d3740e7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:20.500328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed524-29bd-4377-b4bb-e862ce5b6f22 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:20.500611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed524-29bd-4377-b4bb-e862ce5b6f22 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:20.501043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed524-29bd-4377-b4bb-e862ce5b6f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:20.552348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:20.581158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-871ed524-29bd-4377-b4bb-e862ce5b6f22 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:20.590582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-871ed524-29bd-4377-b4bb-e862ce5b6f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:20.662962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 842/1688] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:20.795182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 847/1689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:20.802108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:20.803190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:20.803639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:20.803992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:20.806209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:20.863423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:20.871947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:20.906089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 848/1690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:52:20.910272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:20.918648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:20.942805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c9c4-f5bb-4af3-9665-d436bda5657d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:20.963341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:20.964627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:20.964851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:20.965346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] PATH_INFO: `/v3/users/aecfef75cddf44c1a581ab7b2ffa868b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:20.966775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecfef75cddf44c1a581ab7b2ffa868b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:20.969083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:21.030195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d686c9-0016-47da-b6a4-09d2a72c76c8 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:21.047161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:21.047802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.049101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.050186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.083839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:21.085306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:21.102894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 843/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:21.103984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:21.127404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7cbb9-4b3d-442e-89e3-68a8a6ba2cce service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:21.157773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:21.158849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.163050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.163510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.164700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:21.166269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:21.176819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:21.213505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 844/1692] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:21.218189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:21.231640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56a00-b6ee-499b-9726-8de52d0e885f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:21.253234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb380f-8e75-4411-9de4-6e2575ca91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:21.254144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb380f-8e75-4411-9de4-6e2575ca91d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.256178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb380f-8e75-4411-9de4-6e2575ca91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.257281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb380f-8e75-4411-9de4-6e2575ca91d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.258099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb380f-8e75-4411-9de4-6e2575ca91d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:21.264343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb380f-8e75-4411-9de4-6e2575ca91d8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:21.272242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecfef75cddf44c1a581ab7b2ffa868b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:21.275435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecfef75cddf44c1a581ab7b2ffa868b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:21.405228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecfef75cddf44c1a581ab7b2ffa868b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:21.406572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecfef75cddf44c1a581ab7b2ffa868b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:21.421215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 845/1693] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:21 2022] POST /identity/v3/projects => generated 403 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:21.421450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.423300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.423720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.437794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-060a651d-28ff-4c8b-bd16-3cd9e7d61c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecfef75cddf44c1a581ab7b2ffa868b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:21.464311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] MFA Rules not processed for user `a4cd49cba5ac42a999f95733cc3a466c`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:21.467306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:21.471695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 849/1694] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:20 2022] DELETE /identity/v3/users/aecfef75cddf44c1a581ab7b2ffa868b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:21.474063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.475918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.477783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.548386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:21.554424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] MFA Rules not processed for user `2dc650cb1f194ae5a40ac77e02f267a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:21.560438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:21.594664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 846/1695] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:21.596720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:21.604715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:21.765755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ffcd-3d33-40b8-88b6-3d6acc75929a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:21.768037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 850/1696] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:21.769309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:21.770951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:21.774621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:21.775365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.775726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.776204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.779426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:21.798816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:21.800693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e86d7-ca2a-4199-a816-26188e26e7bb service placement] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:21.815931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 847/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:21.817932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2274e-f8bc-441a-8ebd-fe88adb0d134 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.818590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2274e-f8bc-441a-8ebd-fe88adb0d134 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.819560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2274e-f8bc-441a-8ebd-fe88adb0d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.832819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:21.864560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-dae2274e-f8bc-441a-8ebd-fe88adb0d134 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:21.868788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dae2274e-f8bc-441a-8ebd-fe88adb0d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:21.900342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b5f9-00bc-484d-8acb-88a069fa3db2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:21.912139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:21.913827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:21.914556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:21.915708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:21.916307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:21.920668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.027934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 848/1698] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:22.029532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.030380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.031935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.047040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 851/1699] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:21 2022] POST /identity/v3/users => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:22.051959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:22.070334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec9b2f-56d3-4935-8b7a-dc5391917b69 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:22.077135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:22.081632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.081632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.081632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.081632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:22.082998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.114858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] MFA Rules not processed for user `2dc650cb1f194ae5a40ac77e02f267a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:22.116595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:22.118940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 852/1700] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:52:22.120652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:22.124389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:22.133169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 849/1701] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:22.151481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:22.189323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465f978-95a4-40c8-a517-6112b8d6313d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:22.210218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:22.212200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.213309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.215927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.220111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:22.223458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.268400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 850/1702] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:22.268400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:22.273298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:22.340146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb678e20-8511-499d-8979-a7a205bb2ecd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:22.350333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:22.353721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.353921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.354163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.381794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:22.396794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.442619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 853/1703] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:22.444465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:22.452612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:22.488003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1096f-3872-4a6b-a452-b641f7ca4540 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:22.511894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:22.512726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.513142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.513526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] PATH_INFO: `/v3/projects/50b0dc9e7c054761939ec77c62c5cf45` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.518198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b0dc9e7c054761939ec77c62c5cf45)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:22.521474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.527829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a5a9c-58d4-437e-b6c1-bec3e8a55edc admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:22.541765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:22.542544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.544637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.545032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.571364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:22.578899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.614639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 851/1704] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:22.616275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:22.637185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793cbb6-56ea-405f-be53-eb856904293f service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:22.648983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c5851-36db-4860-9124-836ffd3b5b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:22.649881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c5851-36db-4860-9124-836ffd3b5b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.650256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c5851-36db-4860-9124-836ffd3b5b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.650725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c5851-36db-4860-9124-836ffd3b5b8c admin admin] PATH_INFO: `/v3/projects/78132ef9f82b4730b5660e8655f88975/users/9350f5df0b8947ddae30ad9c4bfb7e83/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.685809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:22.725394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b0dc9e7c054761939ec77c62c5cf45', 'request_id': 'req-102105e0-0c28-4d54-b10d-d6870fa33e85'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:22.753950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c5851-36db-4860-9124-836ffd3b5b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78132ef9f82b4730b5660e8655f88975, user_id=9350f5df0b8947ddae30ad9c4bfb7e83, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:22.756877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c5851-36db-4860-9124-836ffd3b5b8c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:22.760408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b0dc9e7c054761939ec77c62c5cf45', 'request_id': 'req-102105e0-0c28-4d54-b10d-d6870fa33e85'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:22.876586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 852/1705] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:22 2022] PUT /identity/v3/projects/78132ef9f82b4730b5660e8655f88975/users/9350f5df0b8947ddae30ad9c4bfb7e83/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:22.878273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.880202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.885349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b0dc9e7c054761939ec77c62c5cf45', 'request_id': 'req-102105e0-0c28-4d54-b10d-d6870fa33e85'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:22.904902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.912544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] The token cache is being invalidate because project 50b0dc9e7c054761939ec77c62c5cf45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:22.913036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:22.919648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-102105e0-0c28-4d54-b10d-d6870fa33e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:22.923562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 854/1706] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:22 2022] DELETE /identity/v3/projects/50b0dc9e7c054761939ec77c62c5cf45 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:22.929493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:22.933644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:22.934880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:22.964317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:22.965756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:22.981757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] MFA Rules not processed for user `0b632f0be1ea46278a685170f899219f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:22.984720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:22.999441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:23.121968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 855/1707] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:23.121968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:23.124985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.152876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bd9df-b491-49c8-92c7-b2f433997d85 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:23.160768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 853/1708] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:23.162429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:23.172016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.185284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:23.185284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.185284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.185284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] PATH_INFO: `/v3/users/3be8eb0c41714e289ee0490da780a5f4` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.186319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be8eb0c41714e289ee0490da780a5f4)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:23.192094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:23.372702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa136-f278-4152-be2f-3cc23a477b78 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:23.386667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4bc0f-bce9-4cbe-9862-487512257af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:23.387266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4bc0f-bce9-4cbe-9862-487512257af1 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.387741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4bc0f-bce9-4cbe-9862-487512257af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.387862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4bc0f-bce9-4cbe-9862-487512257af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.411700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4bc0f-bce9-4cbe-9862-487512257af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:23.419600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4bc0f-bce9-4cbe-9862-487512257af1 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:23.445695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 854/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:23.447138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be8eb0c41714e289ee0490da780a5f4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:23.449397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be8eb0c41714e289ee0490da780a5f4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:23.450057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb04b-1519-4e4e-b286-ad3a73b186b6 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.450354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb04b-1519-4e4e-b286-ad3a73b186b6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.450658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb04b-1519-4e4e-b286-ad3a73b186b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.477103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5d5cb04b-1519-4e4e-b286-ad3a73b186b6 None None] MFA Rules not processed for user `0b632f0be1ea46278a685170f899219f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:23.478703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5d5cb04b-1519-4e4e-b286-ad3a73b186b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.542396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 855/1710] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:23.544036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.544474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.544892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.553377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be8eb0c41714e289ee0490da780a5f4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:23.554077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be8eb0c41714e289ee0490da780a5f4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:23.586741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c21406b5-3b56-4a0d-8c5e-c9197bf51674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be8eb0c41714e289ee0490da780a5f4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:23.618773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 856/1711] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:23 2022] DELETE /identity/v3/users/3be8eb0c41714e289ee0490da780a5f4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:23.625463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf306b-09c9-47f5-850c-17873d144603 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.626449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf306b-09c9-47f5-850c-17873d144603 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.628504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf306b-09c9-47f5-850c-17873d144603 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.629554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] MFA Rules not processed for user `d12e9c1e41264150b70ab2cf08c78b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:23.631159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 857/1712] 10.222.0.27 () {54 vars in 912 bytes} [Wed Sep 14 02:52:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:23.633135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.637210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912848e-332d-4a48-bea1-316303895377 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.639049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912848e-332d-4a48-bea1-316303895377 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.639049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912848e-332d-4a48-bea1-316303895377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.668466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6912848e-332d-4a48-bea1-316303895377 None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:23.670341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6912848e-332d-4a48-bea1-316303895377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.691169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:23.764567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 858/1713] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:52:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:23.786295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 856/1714] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:23.827228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912848e-332d-4a48-bea1-316303895377 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:23.828818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6912848e-332d-4a48-bea1-316303895377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.845170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912848e-332d-4a48-bea1-316303895377 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:23.863453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:23.865216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:23.865505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:23.865781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:23.886648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:23.889947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:23.891198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:23.892663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:23.925943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 859/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:23.926629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:23.959443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:24.064797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:24.174588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e18e1-d64b-4c48-836a-3f2361f7b6f5 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:24.185967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:24.187326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:24.188114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:24.188570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] PATH_INFO: `/v3/projects/a09b0990492f43758fbcaac845d01604` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:24.190073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09b0990492f43758fbcaac845d01604)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:24.191378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: WARNING py.warnings [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 02:52:24.191378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: warnings.warn(msg) Sep 14 02:52:24.191378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: Sep 14 02:52:24.193166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:24.233598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5293ba-df6d-45d6-a4d5-3ce199c244a1 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:24.243164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:24.244630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:24.246152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:24.246708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:24.257615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:24.384604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09b0990492f43758fbcaac845d01604', 'request_id': 'req-abae5583-4556-4674-b5af-c9e5a0f7975e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:24.404925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09b0990492f43758fbcaac845d01604', 'request_id': 'req-abae5583-4556-4674-b5af-c9e5a0f7975e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:24.451987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:24.453821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ec800-83ab-430f-9de0-76f14e22eaf7 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:24.475358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 860/1716] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:24.483079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09b0990492f43758fbcaac845d01604', 'request_id': 'req-abae5583-4556-4674-b5af-c9e5a0f7975e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:24.552442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] The token cache is being invalidate because project a09b0990492f43758fbcaac845d01604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:24.556883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:24.558916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-abae5583-4556-4674-b5af-c9e5a0f7975e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:24.578108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:24.578794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:24.579226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:24.584304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 857/1717] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:23 2022] DELETE /identity/v3/projects/a09b0990492f43758fbcaac845d01604 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:24.627228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:24.629236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:24.825907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:24.857785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 861/1718] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:24.865907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:24.871151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:24.871151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:24.940652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:24.942192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:24.963458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 858/1719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:24.963907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:24.968577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:24.968723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.005034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded51291-cb2b-47fc-b61d-fb072b22eebe None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.005640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd73ca-74f7-4e69-b416-693aab283137 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.012431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.013340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.013772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.014044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.014783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:25.015257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.017320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.032796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.036144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.036429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.036750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] PATH_INFO: `/v3/projects/0c2cfe8e4efd497d9a5fb8f8f4c902cf` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.043380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2cfe8e4efd497d9a5fb8f8f4c902cf)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.044127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 859/1720] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:25.045231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.046608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.115445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dc0fb-7eb2-447b-b922-66b30b954491 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.134452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.136723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.137446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.138023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.138917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.144913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.252864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 860/1721] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:25 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:25.256215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.257881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2cfe8e4efd497d9a5fb8f8f4c902cf', 'request_id': 'req-f565afb2-fb83-485c-ab07-1d3edf8bc727'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:25.293145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2cfe8e4efd497d9a5fb8f8f4c902cf', 'request_id': 'req-f565afb2-fb83-485c-ab07-1d3edf8bc727'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:25.410935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2cfe8e4efd497d9a5fb8f8f4c902cf', 'request_id': 'req-f565afb2-fb83-485c-ab07-1d3edf8bc727'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:25.434411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] The token cache is being invalidate because project 0c2cfe8e4efd497d9a5fb8f8f4c902cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:25.434930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:25.437615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f565afb2-fb83-485c-ab07-1d3edf8bc727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:25.443326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 862/1722] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:24 2022] DELETE /identity/v3/projects/0c2cfe8e4efd497d9a5fb8f8f4c902cf => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:25.448041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0740-ee9b-4327-b59d-2ed6f70a0e5c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.451964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4981d8-d389-4fed-9f06-2d6e3c0aaf13 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.452526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0740-ee9b-4327-b59d-2ed6f70a0e5c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.452957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0740-ee9b-4327-b59d-2ed6f70a0e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.460692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.461499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.465851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.465851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.465851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.468579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.538397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-00bd0740-ee9b-4327-b59d-2ed6f70a0e5c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:25.539963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-00bd0740-ee9b-4327-b59d-2ed6f70a0e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:25.573915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 863/1723] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:25.582980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.583262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.583536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.669279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 861/1724] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:25 2022] POST /identity/v3/users => generated 284 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:25.670353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.673965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:25.675233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:25.681396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:25.719642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9961ca-0a46-4f0b-9fcc-798f5de446bc admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.724489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 864/1725] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:25.734729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.736054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.736693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.736977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.738000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.738847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.748593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.761176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:25.769477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d9ac3-2d3b-4aea-ab7b-ef1acf8a62fd None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.773106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 862/1726] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:25.775152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.789450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.790334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.790819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.791250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.793666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:25.794227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.794610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c34f-0862-4283-bdb1-4ea93259c9ef admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.798321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.842329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.842990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.843259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.843529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.844178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.850220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 865/1727] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:25.851367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.862175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:25.896565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427869-be97-4d71-9715-d976ea3a4e91 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:25.897782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 863/1728] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:25.909066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:25.915328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:25.928394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:25.929070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:25.929392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:25.929614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:25.930252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:25.932200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:26.074773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 866/1729] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:25 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:26.080539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:26.108986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220967-f7ca-4ac4-9445-dbdce312e39f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:26.305341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:26.306093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:26.306517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:26.306893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:26.309153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:26.313842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688c86a-022c-459f-b531-aec131245742 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:26.337833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:26.338642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:26.339846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:26.340313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] PATH_INFO: `/v3/projects/b0c7f15337ee436d9f7b61e6555948fe/users/52e3eb4bef43499baf3965631515ded0/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:26.382803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c7f15337ee436d9f7b61e6555948fe, user_id=52e3eb4bef43499baf3965631515ded0, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:26.385736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:26.406164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:26.409185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6055-c3ee-4577-a6b5-ce24b1a7ca8e service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:26.423529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 864/1730] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:26.425922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a9c9-136e-48a8-a656-65b3c04e486c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:26.426487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a9c9-136e-48a8-a656-65b3c04e486c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:26.426959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a9c9-136e-48a8-a656-65b3c04e486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:26.489086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1cc1a9c9-136e-48a8-a656-65b3c04e486c None None] MFA Rules not processed for user `9350f5df0b8947ddae30ad9c4bfb7e83`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:26.490579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1cc1a9c9-136e-48a8-a656-65b3c04e486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:26.509147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:26.523527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 867/1731] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:26 2022] PUT /identity/v3/projects/b0c7f15337ee436d9f7b61e6555948fe/users/52e3eb4bef43499baf3965631515ded0/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:26.524463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:26.610404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:26.613886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 865/1732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:26.618631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:26.618631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:26.618631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:26.757278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] MFA Rules not processed for user `52e3eb4bef43499baf3965631515ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:26.764917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:26.804651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5404-eb3c-4920-ab66-c283adada9de admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:26.826033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:26.826728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:26.827010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:26.827279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:26.827920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:26.829864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:26.956376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 868/1733] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:26 2022] POST /identity/v3/users => generated 294 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:26.958202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:26.965419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:27.010250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbf1a9-3063-4525-8403-46daf88b53c7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:27.032408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f93201-c436-4602-8244-79d8bb90b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:27.065639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93201-c436-4602-8244-79d8bb90b223 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:27.066188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93201-c436-4602-8244-79d8bb90b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:27.070250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93201-c436-4602-8244-79d8bb90b223 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:27.071196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f93201-c436-4602-8244-79d8bb90b223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:27.083499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f93201-c436-4602-8244-79d8bb90b223 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:27.105341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 866/1734] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:27.109345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:27.165657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f352f5-98de-401b-bb7f-5de963446569 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:27.192021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:27.195271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:27.196985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:27.199471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:27.201308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:27.204349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:27.224766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 869/1735] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:26 2022] POST /identity/v3/projects => generated 403 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:27.229216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:27.229978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:27.230303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:27.272956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 867/1736] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:27.274701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:27.305555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9d91a-98f2-4f97-be76-16d78b115d59 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:27.307090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] MFA Rules not processed for user `2dc650cb1f194ae5a40ac77e02f267a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:27.310105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:27.543509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 870/1737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:27.550487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:27.556422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e275a7e-9172-4ad4-815a-23abf2505107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:27.557361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275a7e-9172-4ad4-815a-23abf2505107 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:27.558971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275a7e-9172-4ad4-815a-23abf2505107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:27.559446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e275a7e-9172-4ad4-815a-23abf2505107 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:27.560329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275a7e-9172-4ad4-815a-23abf2505107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:27.562832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e275a7e-9172-4ad4-815a-23abf2505107 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:27.712272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1284d-6761-4bf4-a655-8bd285d86912 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:27.720585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:27.721415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:27.721864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:27.724827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:27.724827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:27.725605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:27.737494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 868/1738] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:27 2022] POST /identity/v3/projects => generated 373 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:27.737494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:27.737494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:27.737494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:27.816365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:27.861430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 871/1739] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:27 2022] POST /identity/v3/users => generated 308 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:27.861853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:27.862374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:27.864063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:27.905402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac80203-2b81-4730-9ccc-cee2d00106a7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:27.937520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:28.019510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 869/1740] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:52:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:28.044326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:28.061345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:28.061982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.062336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.062638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.063291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:28.064911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:28.081723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 872/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:28.081723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:28.107575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238ed74-b877-45e8-8470-b92107ac69d8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:28.115897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:28.116526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.116802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.117095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.123898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:28.124346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:28.167812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 873/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:28.167812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:28.189881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eafa10-f5bc-4ce9-8a75-ec4172ebec97 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:28.199972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3a546-00d3-4103-8ff4-f7a46891ac1f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:28.205825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:28.208887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.210782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.214709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] PATH_INFO: `/v3/projects/f4393efed6d14d61a126a3e09dadbf98/users/85814fc1db3941a4852a057aa180ad0d/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.227833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:28.228990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.230940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.231981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.233677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:28.237180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:28.267789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4393efed6d14d61a126a3e09dadbf98, user_id=85814fc1db3941a4852a057aa180ad0d, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:28.270924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:28.353099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 870/1743] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:28 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:28.353099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:28.356727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 874/1744] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:28 2022] PUT /identity/v3/projects/f4393efed6d14d61a126a3e09dadbf98/users/85814fc1db3941a4852a057aa180ad0d/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:28.362014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:28.386334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f224fe-492c-46c7-803b-520212ed9259 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:28.492643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:28.493821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.494180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.495406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] PATH_INFO: `/v3/projects/4ce692052fc64530b1c9d5a22d754904/users/a2f3898881794117b80e4224e1e006d1/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.519351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdc7d5-7a9d-4ab2-8d3f-33103ab6847c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:28.519485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce692052fc64530b1c9d5a22d754904, user_id=a2f3898881794117b80e4224e1e006d1, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:28.523644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:28.524448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4faa2-2df9-40d2-83d5-628ee2d18346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:28.525153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4faa2-2df9-40d2-83d5-628ee2d18346 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.525546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4faa2-2df9-40d2-83d5-628ee2d18346 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.525925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4faa2-2df9-40d2-83d5-628ee2d18346 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.527449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4faa2-2df9-40d2-83d5-628ee2d18346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:28.536144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4faa2-2df9-40d2-83d5-628ee2d18346 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:28.561059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 875/1745] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:28.561059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:28.561059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:28.561059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:28.656667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 871/1746] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:28 2022] PUT /identity/v3/projects/4ce692052fc64530b1c9d5a22d754904/users/a2f3898881794117b80e4224e1e006d1/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:28.660437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:28.663002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] MFA Rules not processed for user `85814fc1db3941a4852a057aa180ad0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:28.671518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:28.672571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:28.687572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:28.924056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:28.955487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 876/1747] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:28.961749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:29.074542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04f3f-a85b-4ce3-9701-cb74998e6247 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:29.086808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:29.087778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:29.088254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:29.089346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:29.191308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da2300-319c-4b73-85f6-688d6f58cf35 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:29.215393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:29.217040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:29.219221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:29.219622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] PATH_INFO: `/v3/projects/08e0a0146a294154891dda1f1ed61a7c/users/a100123771864754bb9006ec265f3989/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:29.280314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e0a0146a294154891dda1f1ed61a7c, user_id=a100123771864754bb9006ec265f3989, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:29.289540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:29.306452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:29.311744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:29.334804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 872/1748] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:52:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:52:29.335525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:29.398974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b45dfd-a355-4dae-9a41-ca2fd345d785 service swift] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:29.411134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:29.411758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:29.412032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:29.412311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:29.422876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:29.426524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:29.427596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 877/1749] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:28 2022] PUT /identity/v3/projects/08e0a0146a294154891dda1f1ed61a7c/users/a100123771864754bb9006ec265f3989/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:29.428530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:29.480378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 873/1750] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:29.480378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:29.509494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa763-10ef-4253-8c06-34ee3b17882c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:29.747905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:29.747905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:29.747905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:29.747905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:29.749950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:29.749950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:29.751304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10525e-7323-435b-9265-aaa3d9fa6ded admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:29.751304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:29.751304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:29.751304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:29.752516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:29.752516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:29.752516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:29.753605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 874/1751] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:29.753605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:29.770820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224edac-5ea9-4030-9b6e-50a0e13dcc9e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:29.803157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:29.806553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:29.808233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:29.808933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] PATH_INFO: `/v3/projects/4ce692052fc64530b1c9d5a22d754904/users/a2f3898881794117b80e4224e1e006d1/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:29.818908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce692052fc64530b1c9d5a22d754904, user_id=a2f3898881794117b80e4224e1e006d1, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:29.826812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:29.836244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:29.865297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 875/1752] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:29 2022] PUT /identity/v3/projects/4ce692052fc64530b1c9d5a22d754904/users/a2f3898881794117b80e4224e1e006d1/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:29.870986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:30.016027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91435-5641-4b83-907f-0d6f032b8179 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:30.027982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 878/1753] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:29 2022] POST /identity/v3/projects => generated 387 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:30.031468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:30.051113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aad79c-c933-40cc-9d0e-b7f67796de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:30.052045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad79c-c933-40cc-9d0e-b7f67796de5c admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.053236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad79c-c933-40cc-9d0e-b7f67796de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.058007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad79c-c933-40cc-9d0e-b7f67796de5c admin admin] PATH_INFO: `/v3/projects/08e0a0146a294154891dda1f1ed61a7c/users/a100123771864754bb9006ec265f3989/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.072323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad79c-c933-40cc-9d0e-b7f67796de5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e0a0146a294154891dda1f1ed61a7c, user_id=a100123771864754bb9006ec265f3989, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:30.086435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad79c-c933-40cc-9d0e-b7f67796de5c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:30.137181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 876/1754] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:29 2022] PUT /identity/v3/projects/08e0a0146a294154891dda1f1ed61a7c/users/a100123771864754bb9006ec265f3989/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:30.154654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.155009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.155233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.236744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] MFA Rules not processed for user `a100123771864754bb9006ec265f3989`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:30.238289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:30.377616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87e1b8-a903-40cb-96ad-5bd395145bd9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:30.413553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:30.498905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 877/1755] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:30.511804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:30.511804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:30.568639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:30.571034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.571802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.572354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.576118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:30.580634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:30.647966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278132e0-a4cd-4d49-acbe-682a63ad1ed0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:30.652509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:30.653177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.653574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.653958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.675572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:30.677255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:30.692890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 878/1756] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:30.720672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 879/1757] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:30 2022] POST /identity/v3/users => generated 300 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:30.724127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:30.767358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf473c45-f9c4-47a5-b8a4-decae663f88f service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:30.773623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:30.774659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.774659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.780153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.782025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:30.784984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:30.839296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 879/1758] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:52:30.841974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:30.867663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123d5f-fd86-42e5-8563-c983fce8f1fd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:30.884047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:30.909264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.912542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.912542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] PATH_INFO: `/v3/projects/bdc9ebf0e4b04f88a2066df325393e57/users/47602a843e6b4e1c9cc190495bb852e0/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.971784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:30.985952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766beb-3467-479d-b53b-e6ce27dbde82 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:30.990790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:30.991759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:30.992203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:30.993196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:30.999526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:31.011453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc9ebf0e4b04f88a2066df325393e57, user_id=47602a843e6b4e1c9cc190495bb852e0, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:31.023071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:31.118073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 880/1759] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:30 2022] PUT /identity/v3/projects/bdc9ebf0e4b04f88a2066df325393e57/users/47602a843e6b4e1c9cc190495bb852e0/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:31.123095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:31.145980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:31.147559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:31.174192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 880/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:31.287941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4a669-f547-467d-b8bf-3be6ca28f0a7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:31.298580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c3cf7-e9c0-4c00-a3b9-4f700554a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:31.300272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c3cf7-e9c0-4c00-a3b9-4f700554a2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:31.300272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c3cf7-e9c0-4c00-a3b9-4f700554a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:31.300272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c3cf7-e9c0-4c00-a3b9-4f700554a2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:31.321604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c3cf7-e9c0-4c00-a3b9-4f700554a2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:31.329442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c3cf7-e9c0-4c00-a3b9-4f700554a2d4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:31.369963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 881/1761] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:31.371303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:31.390258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189600-40b2-40c6-a914-4f0685199892 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:31.407902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:31.409059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:31.409342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:31.409646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] PATH_INFO: `/v3/projects/bdc9ebf0e4b04f88a2066df325393e57/users/47602a843e6b4e1c9cc190495bb852e0/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:31.412364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc9ebf0e4b04f88a2066df325393e57, user_id=47602a843e6b4e1c9cc190495bb852e0, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:31.414985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:31.474812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 881/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:31 2022] PUT /identity/v3/projects/bdc9ebf0e4b04f88a2066df325393e57/users/47602a843e6b4e1c9cc190495bb852e0/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:31.483893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:31.484651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:31.484651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:31.571733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] MFA Rules not processed for user `47602a843e6b4e1c9cc190495bb852e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:31.572970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:31.802108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 882/1763] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:31.817668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:31.964714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b2e6-617d-4536-bf9e-72b2bf6724ef admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:31.975297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3857b7-d825-4a1e-b4b5-daa2b400461c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:31.977654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3857b7-d825-4a1e-b4b5-daa2b400461c service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:31.977949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3857b7-d825-4a1e-b4b5-daa2b400461c service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:31.978227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3857b7-d825-4a1e-b4b5-daa2b400461c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:32.005225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3857b7-d825-4a1e-b4b5-daa2b400461c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:32.008116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3857b7-d825-4a1e-b4b5-daa2b400461c service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:32.031990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 882/1764] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:32.117363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:32.124110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:32.172503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:32.172503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:32.172503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:32.274361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:32.280299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:32.424778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba80ce-076e-4071-83bf-c846eca079a8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:32.442966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:32.443828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:32.444189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:32.444611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] PATH_INFO: `/v3/users/85814fc1db3941a4852a057aa180ad0d` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:32.446423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85814fc1db3941a4852a057aa180ad0d)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:32.458100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:32.503613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 883/1765] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Sep 14 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:32.580498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:32.582150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:32.610376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7da02-b5ad-4fe5-a087-d334fdb1dc3a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:32.625969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f371a-0814-4ddf-aa74-d2581f3baafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:32.626546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f371a-0814-4ddf-aa74-d2581f3baafe service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:32.626836 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f371a-0814-4ddf-aa74-d2581f3baafe service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:32.628460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f371a-0814-4ddf-aa74-d2581f3baafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:32.644111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f371a-0814-4ddf-aa74-d2581f3baafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:32.645763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f371a-0814-4ddf-aa74-d2581f3baafe service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:32.668849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 884/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:32.715395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85814fc1db3941a4852a057aa180ad0d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:32.715395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85814fc1db3941a4852a057aa180ad0d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:32.787760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85814fc1db3941a4852a057aa180ad0d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:32.788579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85814fc1db3941a4852a057aa180ad0d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:32.861457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85814fc1db3941a4852a057aa180ad0d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:32.916230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 883/1767] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:32 2022] DELETE /identity/v3/users/85814fc1db3941a4852a057aa180ad0d => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:32.918187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb67a-7ea3-4d1a-9554-e311ada3eb11 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:32.919464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb67a-7ea3-4d1a-9554-e311ada3eb11 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:32.919464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb67a-7ea3-4d1a-9554-e311ada3eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:33.015218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a35bb67a-7ea3-4d1a-9554-e311ada3eb11 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:33.016599 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a35bb67a-7ea3-4d1a-9554-e311ada3eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:33.122367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:33.212204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 885/1768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:33.250542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:33.254776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:33.480530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d162c60-5d9b-4577-bdfe-a334b5a6c5c7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:33.498349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:33.502396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:33.502745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:33.503025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:33.536716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:33.538192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:33.565249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 884/1769] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:34.483193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a1e13-93f3-44c3-863d-afb906dcd03a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:34.484471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a1e13-93f3-44c3-863d-afb906dcd03a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:34.484952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a1e13-93f3-44c3-863d-afb906dcd03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:34.537850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a91a1e13-93f3-44c3-863d-afb906dcd03a None None] MFA Rules not processed for user `d12e9c1e41264150b70ab2cf08c78b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:34.540372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a91a1e13-93f3-44c3-863d-afb906dcd03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:34.735425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 886/1770] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:37.273416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:37.276755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:37.320947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f673c0d-8ce8-4407-a78e-9b0096f615a0 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:37.356936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:37.356936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:37.356936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:37.356936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] PATH_INFO: `/v3/projects/f4393efed6d14d61a126a3e09dadbf98` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:37.358076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4393efed6d14d61a126a3e09dadbf98)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:37.367662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:37.462449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445ac4-0f51-4238-84a6-9541b25df07b None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:37.465445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445ac4-0f51-4238-84a6-9541b25df07b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:37.465445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db445ac4-0f51-4238-84a6-9541b25df07b None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:37.471651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 887/1771] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:52:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:37.473040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:37.497513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:37.498716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:37.500293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:37.634274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:37.638580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:37.675909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4393efed6d14d61a126a3e09dadbf98', 'request_id': 'req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:37.704470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4393efed6d14d61a126a3e09dadbf98', 'request_id': 'req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:37.774818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 888/1772] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:52:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:37.799575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4393efed6d14d61a126a3e09dadbf98', 'request_id': 'req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:37.819097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] The token cache is being invalidate because project f4393efed6d14d61a126a3e09dadbf98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:37.820648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:37.821732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fc27d00f-2cc3-4dbb-8c25-06553a9a9945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:37.827657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 885/1773] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:37 2022] DELETE /identity/v3/projects/f4393efed6d14d61a126a3e09dadbf98 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:37.831962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:38.005603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31643b8c-385d-490d-b20b-5941008208c1 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:38.013493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:38.014182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:38.014602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:38.014800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] PATH_INFO: `/v3/users/47602a843e6b4e1c9cc190495bb852e0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:38.018783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=47602a843e6b4e1c9cc190495bb852e0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:38.021047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:38.039850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:38.087563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad731ac2-98c5-46e1-bd1f-fe3522b8833e None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:38.087916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad731ac2-98c5-46e1-bd1f-fe3522b8833e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:38.088223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad731ac2-98c5-46e1-bd1f-fe3522b8833e None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:38.090613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 886/1774] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:38.133058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47862e-b124-4867-996d-329294f409ab None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:38.133288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47862e-b124-4867-996d-329294f409ab None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:38.133601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47862e-b124-4867-996d-329294f409ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:38.190290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7a47862e-b124-4867-996d-329294f409ab None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:38.195084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7a47862e-b124-4867-996d-329294f409ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:38.218831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 887/1775] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:52:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:52:38.345748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47602a843e6b4e1c9cc190495bb852e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:38.445552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47602a843e6b4e1c9cc190495bb852e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:38.446253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47602a843e6b4e1c9cc190495bb852e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:38.446896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47602a843e6b4e1c9cc190495bb852e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:38.462768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47602a843e6b4e1c9cc190495bb852e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:38.512140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 889/1776] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:37 2022] DELETE /identity/v3/users/47602a843e6b4e1c9cc190495bb852e0 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:39.133067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:39.133688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:39.133790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:39.183284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] MFA Rules not processed for user `a2f3898881794117b80e4224e1e006d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:39.184583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:39.435306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 888/1777] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:41.213273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:41.216596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:41.438059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedeb66-b3c1-46f7-85d4-28d4189085ef admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:41.455254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:41.459548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:41.459548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:41.460688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:41.466232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:41.466860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:41.468465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:41.499512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:41.504525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:41.549471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 890/1778] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:41.730038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e2ba-423d-4061-a963-ba3084045ede None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:41.744061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:41.744472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:41.744836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:41.745999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] PATH_INFO: `/v3/projects/bdc9ebf0e4b04f88a2066df325393e57` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:41.747761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:41.752568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc9ebf0e4b04f88a2066df325393e57)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:41.755229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:41.771413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aef12-3055-4ff3-afc4-d0caa1a1a5e3 service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:41.788841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:41.789647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:41.790097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:41.790564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:41.800181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:41.841140 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:41.846710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc37139-8ccb-4a2f-9d89-55aa5681c82f service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:41.880967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 891/1779] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:41.924291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:41.965797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc9ebf0e4b04f88a2066df325393e57', 'request_id': 'req-4790e39f-a59c-4228-aa27-17cab040f2ab'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:41.985112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc9ebf0e4b04f88a2066df325393e57', 'request_id': 'req-4790e39f-a59c-4228-aa27-17cab040f2ab'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:42.086176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc9ebf0e4b04f88a2066df325393e57', 'request_id': 'req-4790e39f-a59c-4228-aa27-17cab040f2ab'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:42.109221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] The token cache is being invalidate because project bdc9ebf0e4b04f88a2066df325393e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:42.110714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:42.113673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4790e39f-a59c-4228-aa27-17cab040f2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:42.119243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 889/1780] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:41 2022] DELETE /identity/v3/projects/bdc9ebf0e4b04f88a2066df325393e57 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:42.125086 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8d3b-f304-45e9-9b26-761d92ebb350 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.126047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8d3b-f304-45e9-9b26-761d92ebb350 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.126047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8d3b-f304-45e9-9b26-761d92ebb350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.165561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f14d8d3b-f304-45e9-9b26-761d92ebb350 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:42.167837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f14d8d3b-f304-45e9-9b26-761d92ebb350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:42.248307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e83b6-7cd6-4a63-9711-89456dc29d87 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.248640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e83b6-7cd6-4a63-9711-89456dc29d87 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.248847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e83b6-7cd6-4a63-9711-89456dc29d87 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.250814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 890/1781] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:42.292501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:42.315777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 892/1782] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:42.327141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.327141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.327141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.328157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.328686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.329318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.373915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:42.375849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:42.380576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:42.380576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:42.438973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 891/1783] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:42.442934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:42.481340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014a421-01dc-4349-97b3-d7caa59adfd7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:42.510123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:42.510942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.511234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.511851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 893/1784] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:42.518917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.519729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:42.520045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:42.521854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:42.556510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 892/1785] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:42.562061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:42.579476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2030f3-a4e1-44bc-9075-6b16b2efd32b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:42.590277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:42.593064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:42.594966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:42.596242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.596640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.597294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.598159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:42.600647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:42.621791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4c04-b58e-494f-a3a1-a5b1f317a19d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:42.628603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:42.629567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.629846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.630453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.648472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:42.651830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:42.666078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 893/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:42.737190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:42.738582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 894/1787] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:42 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:42.752064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186503-9d3e-4f8d-a4d2-4a160e048646 service placement] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:42.923124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:42.931295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:42.931583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:42.933361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:42.936968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:42.936968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:43.068609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 894/1788] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:42 2022] POST /identity/v3/users => generated 290 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:52:43.073434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:43.095929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9208794-33df-4e2a-b0ea-b3467d48e5a8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:43.109765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:43.114614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:43.117896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:43.118334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:43.119178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:43.129745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:43.177772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 895/1789] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:52:43.182130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:43.205133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdb27-e39a-44ba-bb50-e975f89af0ec admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:43.232433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e5214-84a8-451e-89b0-574889fb2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:43.233509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5214-84a8-451e-89b0-574889fb2ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:43.233757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5214-84a8-451e-89b0-574889fb2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:43.234091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5214-84a8-451e-89b0-574889fb2ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:43.235075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e5214-84a8-451e-89b0-574889fb2ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:43.237381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e5214-84a8-451e-89b0-574889fb2ca6 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:43.280971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 895/1790] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:43.285166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:43.311995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e054-3a4e-4a58-8634-c29b1c90d7b1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:43.327643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:43.329577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:43.329577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:43.329799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] PATH_INFO: `/v3/projects/75342a1ef9e74493b871f47cfda3c0fb/users/d6c90ccde0cc49388ed38c3c4a98d81a/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:43.409408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75342a1ef9e74493b871f47cfda3c0fb, user_id=d6c90ccde0cc49388ed38c3c4a98d81a, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:43.420473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:43.507792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 896/1791] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:43 2022] PUT /identity/v3/projects/75342a1ef9e74493b871f47cfda3c0fb/users/d6c90ccde0cc49388ed38c3c4a98d81a/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:43.519423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6675971-a45a-4248-aed8-4e140954379b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:43.520776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6675971-a45a-4248-aed8-4e140954379b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:43.521306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6675971-a45a-4248-aed8-4e140954379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:43.615693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f6675971-a45a-4248-aed8-4e140954379b None None] MFA Rules not processed for user `d6c90ccde0cc49388ed38c3c4a98d81a`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:43.618634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f6675971-a45a-4248-aed8-4e140954379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:43.785336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:43.833803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 896/1792] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:43.834202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:43.976218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1eba-c883-401f-9b04-5b300341e573 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.000897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.005329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.005329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.005329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.005329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.005632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.189235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 897/1793] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:43 2022] POST /identity/v3/projects => generated 379 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:44.191855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6675971-a45a-4248-aed8-4e140954379b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:44.215241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6675971-a45a-4248-aed8-4e140954379b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.264798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:44.267405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:44.349417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.350661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.351149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.351623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.352825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.356367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.361139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:44.418803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee58ac-bb14-4b9a-82ac-6a473d7983c5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.438936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.442872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.443627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.444077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] PATH_INFO: `/v3/users/9350f5df0b8947ddae30ad9c4bfb7e83` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.445762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9350f5df0b8947ddae30ad9c4bfb7e83)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.454671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.462420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 897/1794] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:44 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:44.466611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:44.488012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c0b5-e956-4a9b-a6ad-e7b22262e343 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.499959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.501492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.501838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.502121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.502818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.504768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.520903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 898/1795] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:44.529646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:44.539949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e0396-a025-4b73-9c40-9ac98a87a905 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.548494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.549513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.549979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.550321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] PATH_INFO: `/v3/projects/1cfad837797d40299dba493b836546fc/users/e63f9a50bc2040bba9c4bc3c3a205c9b/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.571457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfad837797d40299dba493b836546fc, user_id=e63f9a50bc2040bba9c4bc3c3a205c9b, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.575218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.702630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 899/1796] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:44 2022] PUT /identity/v3/projects/1cfad837797d40299dba493b836546fc/users/e63f9a50bc2040bba9c4bc3c3a205c9b/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:44.709107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:44.741670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9350f5df0b8947ddae30ad9c4bfb7e83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:44.782829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7613-3d97-46cf-ba9d-68c9d2afef41 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.789899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.796287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.796287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.796287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.796287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.796287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.804802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9350f5df0b8947ddae30ad9c4bfb7e83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:44.805709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9350f5df0b8947ddae30ad9c4bfb7e83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:44.808050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9350f5df0b8947ddae30ad9c4bfb7e83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:44.811581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 900/1797] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:52:44.812845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:44.814630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:44.820726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7766eec4-e7e1-40bd-a0e9-7880db7c6164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9350f5df0b8947ddae30ad9c4bfb7e83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:44.841673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe63ec-a78c-44d3-8e32-13662d1bf6e9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:44.848441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 898/1798] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:44 2022] DELETE /identity/v3/users/9350f5df0b8947ddae30ad9c4bfb7e83 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:44.854000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:44.854969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.855250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.855524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] PATH_INFO: `/v3/projects/1cfad837797d40299dba493b836546fc/users/e63f9a50bc2040bba9c4bc3c3a205c9b/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.857595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfad837797d40299dba493b836546fc, user_id=e63f9a50bc2040bba9c4bc3c3a205c9b, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:44.861087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:44.885439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 901/1799] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:44 2022] PUT /identity/v3/projects/1cfad837797d40299dba493b836546fc/users/e63f9a50bc2040bba9c4bc3c3a205c9b/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:44.887172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:44.887516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:44.887798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:44.936101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] MFA Rules not processed for user `e63f9a50bc2040bba9c4bc3c3a205c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:44.938952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:45.131205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 899/1800] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:45.148044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:45.150460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:45.188046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:45.216523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62457b7-b0ba-4a98-ac72-829c1578ccc7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:45.220351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:45.220969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:45.221335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:45.221687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:45.223575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:45.230141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:45.231747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:45.306138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:45.307658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:45.308082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:45.319953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 902/1801] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:45.352906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a911d-79f1-4f53-9a79-26576f4fda9e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:45.361997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:45.361997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:45.361997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:45.361997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] PATH_INFO: `/v3/projects/78132ef9f82b4730b5660e8655f88975` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:45.363361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78132ef9f82b4730b5660e8655f88975)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:45.365985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:45.565462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78132ef9f82b4730b5660e8655f88975', 'request_id': 'req-fe867263-ff2e-4d30-9b88-e6af51ab72c5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:45.575722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78132ef9f82b4730b5660e8655f88975', 'request_id': 'req-fe867263-ff2e-4d30-9b88-e6af51ab72c5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:45.739870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78132ef9f82b4730b5660e8655f88975', 'request_id': 'req-fe867263-ff2e-4d30-9b88-e6af51ab72c5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:45.750913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] The token cache is being invalidate because project 78132ef9f82b4730b5660e8655f88975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:45.751202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:45.751860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:45.753558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 900/1802] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:45 2022] DELETE /identity/v3/projects/78132ef9f82b4730b5660e8655f88975 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:45.757735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:45.768598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076498b-5b0b-4f9a-b9e6-a225b41070de service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:45.828620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:45.829250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:45.829534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:45.829816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] PATH_INFO: `/v3/users/a2f3898881794117b80e4224e1e006d1` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:45.830987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f3898881794117b80e4224e1e006d1)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:45.836968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:46.031415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f3898881794117b80e4224e1e006d1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.032098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f3898881794117b80e4224e1e006d1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.124907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f3898881794117b80e4224e1e006d1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.125499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f3898881794117b80e4224e1e006d1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.156251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8b23fd9-50b9-49e7-9532-b30a06d519a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f3898881794117b80e4224e1e006d1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.174769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 903/1803] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:45 2022] DELETE /identity/v3/users/a2f3898881794117b80e4224e1e006d1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:46.446454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:46.449585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:46.463727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867263-ff2e-4d30-9b88-e6af51ab72c5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:46.526542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:46.529359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:46.529359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:46.529359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] PATH_INFO: `/v3/projects/4ce692052fc64530b1c9d5a22d754904` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:46.529691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce692052fc64530b1c9d5a22d754904)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:46.531524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:46.790927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce692052fc64530b1c9d5a22d754904', 'request_id': 'req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.803590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce692052fc64530b1c9d5a22d754904', 'request_id': 'req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.896003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce692052fc64530b1c9d5a22d754904', 'request_id': 'req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.897533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:46.908419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] The token cache is being invalidate because project 4ce692052fc64530b1c9d5a22d754904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:46.908794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.909751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e6ec29b-1ebb-425f-b522-bfe1457bf2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:46.911399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 901/1804] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:46 2022] DELETE /identity/v3/projects/4ce692052fc64530b1c9d5a22d754904 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:46.916372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:46.917018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:46.917018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:46.924850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:46.939972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:46.941905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:47.005992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 904/1805] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:47.014432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e714447-8043-4ba2-961a-007646738b3c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.014687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e714447-8043-4ba2-961a-007646738b3c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.020989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e714447-8043-4ba2-961a-007646738b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.035029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1e714447-8043-4ba2-961a-007646738b3c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:47.036225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1e714447-8043-4ba2-961a-007646738b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:47.044464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 902/1806] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:47.048627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.058921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e25336-3058-4ae7-8de5-1c3dfdfca3e2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.063553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.064151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.064447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.064716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.065353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:47.065654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.067288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.083123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 905/1807] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:47.084497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e714447-8043-4ba2-961a-007646738b3c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.093912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e714447-8043-4ba2-961a-007646738b3c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.107228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.107228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.107228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.107228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.107589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.122904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.211230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 903/1808] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:47 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:47.215144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.225089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.225227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7cac-75cd-4812-b68f-efc769293367 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.227102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:47.289847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.290492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.290766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.291044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.291839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.293428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8588-b2eb-414d-86e4-095b130013ce admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.293986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.308610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.311062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.311659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.312216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.314563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:47.389836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 906/1809] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:47 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:52:47.392771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.403453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11da5-39a5-4bda-84cf-29f1ba79b3a7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.421565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.423635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.424485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.425317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.426917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.427404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.428565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.430200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.458221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 904/1810] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:47.458765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 907/1811] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:47.461183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.477047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f7b44-f421-4e31-bbac-878378d29494 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.484664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb8992-9252-4fe3-98c2-363ca8d4cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.485515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb8992-9252-4fe3-98c2-363ca8d4cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.485865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb8992-9252-4fe3-98c2-363ca8d4cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.486209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb8992-9252-4fe3-98c2-363ca8d4cfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.487000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb8992-9252-4fe3-98c2-363ca8d4cfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.488752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb8992-9252-4fe3-98c2-363ca8d4cfeb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.506809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 908/1812] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:47.507301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.521644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7b95-e7c6-4472-99c9-cf9a6886f018 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.526588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.527452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.527738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.528013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] PATH_INFO: `/v3/projects/d6681cd703134b73a1dd1ec08a0dcd1c/users/169f257fb30f453b9e81dc21512c3c25/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.546747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6681cd703134b73a1dd1ec08a0dcd1c, user_id=169f257fb30f453b9e81dc21512c3c25, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.549731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.667192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 905/1813] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:47 2022] PUT /identity/v3/projects/d6681cd703134b73a1dd1ec08a0dcd1c/users/169f257fb30f453b9e81dc21512c3c25/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:47.678749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.679034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.679304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.707652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] MFA Rules not processed for user `169f257fb30f453b9e81dc21512c3c25`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:47.708848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:47.771641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 909/1814] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:47.776753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.849367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a277918-fa5e-45b8-a956-f93145dc89da admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:47.855872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:47.856500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:47.863663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:47.863663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:47.863663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:47.863663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:47.879351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:47.943571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 906/1815] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:47.949193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:47.960910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d90c35-48c1-439e-b696-040fd2c1fec4 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.004848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:48.030122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.030793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.031082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.031373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.032012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.034262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:48.166688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 910/1816] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:47 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:48.171799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:48.186884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054044d0-7aea-48ee-a5f1-de15650c91c6 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.197054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.197054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.197054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.197054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.197363 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.197363 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:48.211715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 907/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:48.213179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:48.225780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d4de-75a3-41f3-abcc-64e6e31a4f97 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.232387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.233579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.233869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.234140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] PATH_INFO: `/v3/projects/71e47f0164c5483882293838ba4a477c/users/1d1692bad6024e699ee6f2812cd4356d/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.255584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e47f0164c5483882293838ba4a477c, user_id=1d1692bad6024e699ee6f2812cd4356d, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.259004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:48.336268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 911/1818] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:48 2022] PUT /identity/v3/projects/71e47f0164c5483882293838ba4a477c/users/1d1692bad6024e699ee6f2812cd4356d/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:48.340311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:48.350027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3f70e-cea5-4aeb-93db-ca7bca4cc953 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.406767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef41a58-69b8-4343-ad82-5730a3425e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.407372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41a58-69b8-4343-ad82-5730a3425e1d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.407648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41a58-69b8-4343-ad82-5730a3425e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.407917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef41a58-69b8-4343-ad82-5730a3425e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.408580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41a58-69b8-4343-ad82-5730a3425e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.410408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef41a58-69b8-4343-ad82-5730a3425e1d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:48.420778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 908/1819] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:48.425004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:48.438017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f9ac9-a30f-4d8e-9e19-d14eed967d9a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.441439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.442088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.442366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.442703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] PATH_INFO: `/v3/projects/71e47f0164c5483882293838ba4a477c/users/1d1692bad6024e699ee6f2812cd4356d/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.444764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e47f0164c5483882293838ba4a477c, user_id=1d1692bad6024e699ee6f2812cd4356d, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.447580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:48.458318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 912/1820] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:48 2022] PUT /identity/v3/projects/71e47f0164c5483882293838ba4a477c/users/1d1692bad6024e699ee6f2812cd4356d/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:48.469205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.469787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.469787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.502825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] MFA Rules not processed for user `1d1692bad6024e699ee6f2812cd4356d`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:48.504101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:48.577793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 909/1821] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:48.588991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:48.590686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:48.659375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91f700-90ce-4ad2-a05d-f2a2517d3e48 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.663646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e001c-9b11-404a-9dc6-a1b166cca08a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.664250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e001c-9b11-404a-9dc6-a1b166cca08a service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.664523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e001c-9b11-404a-9dc6-a1b166cca08a service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.668231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e001c-9b11-404a-9dc6-a1b166cca08a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.675209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e001c-9b11-404a-9dc6-a1b166cca08a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.677020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e001c-9b11-404a-9dc6-a1b166cca08a service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:48.687389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 913/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:48.834514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:48.883386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:48.903725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe53ea-614a-4dda-9558-002d9660e19b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:48.908721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:48.909628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:48.909921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:48.911798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] PATH_INFO: `/v3/users/169f257fb30f453b9e81dc21512c3c25` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:48.911798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169f257fb30f453b9e81dc21512c3c25)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:48.913564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:49.124787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169f257fb30f453b9e81dc21512c3c25'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:49.210328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169f257fb30f453b9e81dc21512c3c25'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:49.211088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169f257fb30f453b9e81dc21512c3c25'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:49.211802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169f257fb30f453b9e81dc21512c3c25'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:49.222763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169f257fb30f453b9e81dc21512c3c25'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:49.284538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 910/1823] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:48 2022] DELETE /identity/v3/users/169f257fb30f453b9e81dc21512c3c25 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:49.285471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fef10-24ec-4b8c-8113-e5ec9c045605 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:49.285938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fef10-24ec-4b8c-8113-e5ec9c045605 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:49.286043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fef10-24ec-4b8c-8113-e5ec9c045605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:49.342288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-878fef10-24ec-4b8c-8113-e5ec9c045605 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:49.343549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-878fef10-24ec-4b8c-8113-e5ec9c045605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:49.478111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:49.509069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 914/1824] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:52:49.516577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:49.518833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:49.615815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37179f0-a04f-4f32-84a6-7ed1dd1ac858 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:49.621007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0a07-1fe2-4a7a-ab83-0d902401f372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:49.621804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0a07-1fe2-4a7a-ab83-0d902401f372 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:49.622260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0a07-1fe2-4a7a-ab83-0d902401f372 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:49.622737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0a07-1fe2-4a7a-ab83-0d902401f372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:49.637438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0a07-1fe2-4a7a-ab83-0d902401f372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:49.639719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0a07-1fe2-4a7a-ab83-0d902401f372 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:49.654736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 911/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:50.013684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7360b2-f458-465e-bc2d-7c78755b9471 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:50.014130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7360b2-f458-465e-bc2d-7c78755b9471 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:50.014767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7360b2-f458-465e-bc2d-7c78755b9471 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:50.016198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 915/1826] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:52:50.080401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:50.080975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:50.081406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:50.132711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:50.133942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:50.226645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:50.241079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 912/1827] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:50.310842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7360b2-f458-465e-bc2d-7c78755b9471 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:50.310842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2b7360b2-f458-465e-bc2d-7c78755b9471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:50.373697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7360b2-f458-465e-bc2d-7c78755b9471 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:50.389331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:50.390232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:50.390682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:50.391082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] PATH_INFO: `/v3/projects/d6681cd703134b73a1dd1ec08a0dcd1c` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:50.393135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6681cd703134b73a1dd1ec08a0dcd1c)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:50.396467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:50.570290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6681cd703134b73a1dd1ec08a0dcd1c', 'request_id': 'req-86d9892a-648e-4ba3-a4d3-95aca41b4c14'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:50.577868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6681cd703134b73a1dd1ec08a0dcd1c', 'request_id': 'req-86d9892a-648e-4ba3-a4d3-95aca41b4c14'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:50.601622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:50.603154 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:50.620356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502e21-dd68-4edc-bdc3-803aa0c64382 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:50.686839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:50.687494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:50.687775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:50.688093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:50.695872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6681cd703134b73a1dd1ec08a0dcd1c', 'request_id': 'req-86d9892a-648e-4ba3-a4d3-95aca41b4c14'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:50.699008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:50.705432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:50.709825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] The token cache is being invalidate because project d6681cd703134b73a1dd1ec08a0dcd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:50.710112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:50.710990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:50.712582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 916/1828] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:50 2022] DELETE /identity/v3/projects/d6681cd703134b73a1dd1ec08a0dcd1c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:50.712990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 913/1829] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:50.723862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:50.726104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:50.809731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9892a-648e-4ba3-a4d3-95aca41b4c14 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:50.816256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:50.817206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:50.817492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:50.817766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] PATH_INFO: `/v3/users/1d1692bad6024e699ee6f2812cd4356d` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:50.818964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1692bad6024e699ee6f2812cd4356d)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:50.820899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:51.013195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1692bad6024e699ee6f2812cd4356d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:51.014159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1692bad6024e699ee6f2812cd4356d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:51.101572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1692bad6024e699ee6f2812cd4356d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:51.102216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1692bad6024e699ee6f2812cd4356d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:51.122053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:51.125569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8d09eef6-6a12-4bd4-9f7a-b02e896853ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1692bad6024e699ee6f2812cd4356d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:51.145419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 917/1830] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:50 2022] DELETE /identity/v3/users/1d1692bad6024e699ee6f2812cd4356d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:51.700518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:51.712801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba640a-10f4-4c33-96a1-43a122c3fefb service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:51.786160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:51.786907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:51.787320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:51.787713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] PATH_INFO: `/v3/projects/71e47f0164c5483882293838ba4a477c` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:51.788839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e47f0164c5483882293838ba4a477c)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:51.791318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:51.955235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e47f0164c5483882293838ba4a477c', 'request_id': 'req-926575a0-5077-48e7-a979-780ea687507d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:51.964099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e47f0164c5483882293838ba4a477c', 'request_id': 'req-926575a0-5077-48e7-a979-780ea687507d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.033684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e47f0164c5483882293838ba4a477c', 'request_id': 'req-926575a0-5077-48e7-a979-780ea687507d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.050746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] The token cache is being invalidate because project 71e47f0164c5483882293838ba4a477c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:52.051188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.052371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-926575a0-5077-48e7-a979-780ea687507d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.057698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 914/1831] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:51 2022] DELETE /identity/v3/projects/71e47f0164c5483882293838ba4a477c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:52.061847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.062318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.062452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.101288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:52.102588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:52.195418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 918/1832] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:52:52.203398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.203907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.204334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.227890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:52.229887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:52.239605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 915/1833] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:52.245444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.256449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc5b00-cf4a-405a-9170-0da523bd2d45 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.262441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.262441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.263244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.263244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.263902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:52.264629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.266012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.282922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 919/1834] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:52:52.285190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.299211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:52.304066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfeb0df-36ab-4db8-b469-6a54d9c1aa5d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.310801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.312241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.312845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.313536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.314372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.316942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.330688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.333045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:52.356176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910dc07-c592-4cd9-a901-5a7ffae4b8de admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.370696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.371949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.372450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.372869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] PATH_INFO: `/v3/users/d6c90ccde0cc49388ed38c3c4a98d81a` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.378915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c90ccde0cc49388ed38c3c4a98d81a)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.382930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.421568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 916/1835] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:52 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:52.425847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.514981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a2b50-56d2-482a-a513-6112862de00e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.520210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.520912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.521391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.521914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.522758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.524770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.628013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 917/1836] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:52 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:52:52.632429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.645797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc1a64-3234-4a76-a273-8e1d0babfce6 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.654364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.655029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.655431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.655715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.656373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.658185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.673235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 918/1837] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:52.673360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c90ccde0cc49388ed38c3c4a98d81a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.675538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c90ccde0cc49388ed38c3c4a98d81a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.676473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.688442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e839c6-c1e7-4f70-9591-d0f959a79751 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.693690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.694393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.694756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.695036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.695691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.697292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.712374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 919/1838] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:52.717210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.735742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba1922-4e6a-4baf-99aa-d1a0bd620d8b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:52.743654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423a6f1-b44d-4368-8183-12acdd4b35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:52.744560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a6f1-b44d-4368-8183-12acdd4b35f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.745383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a6f1-b44d-4368-8183-12acdd4b35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.746452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a6f1-b44d-4368-8183-12acdd4b35f7 admin admin] PATH_INFO: `/v3/projects/fbe0505ebbaf4f6ebc19974e99286ae6/users/adfbf9b5f39642bb8942fedddfdfb080/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.769347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423a6f1-b44d-4368-8183-12acdd4b35f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe0505ebbaf4f6ebc19974e99286ae6, user_id=adfbf9b5f39642bb8942fedddfdfb080, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:52.770279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c90ccde0cc49388ed38c3c4a98d81a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.770969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c90ccde0cc49388ed38c3c4a98d81a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.772917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423a6f1-b44d-4368-8183-12acdd4b35f7 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:52.790067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f919c8b-4f80-460a-a354-29ae9758307c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c90ccde0cc49388ed38c3c4a98d81a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:52.811148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 920/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:52 2022] DELETE /identity/v3/users/d6c90ccde0cc49388ed38c3c4a98d81a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:52.815960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.816695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.817395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.837514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:52.838798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:52.872380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 920/1840] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:52 2022] PUT /identity/v3/projects/fbe0505ebbaf4f6ebc19974e99286ae6/users/adfbf9b5f39642bb8942fedddfdfb080/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:52.883669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:52.883959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:52.884233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:52.891001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:52.926289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 921/1841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:52.928177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] MFA Rules not processed for user `adfbf9b5f39642bb8942fedddfdfb080`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:52.929413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:52.935480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:52.937368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:53.061445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 921/1842] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:53.066386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:53.067714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:53.085567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416128a-4626-483f-9bff-1708c53eb9ba None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:53.421386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:53.421386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:53.421386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:53.421386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:53.422744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a43313-ef28-45ba-bf52-c9210717dc6d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:53.424589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:53.424695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:53.424695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:53.424695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:53.424695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:53.425027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:53.425116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:53.425116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:53.425281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 922/1843] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:52:53.452895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 922/1844] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:53 2022] POST /identity/v3/projects => generated 385 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:52:53.457010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:53.468369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314c7b-a44c-4552-98b6-76980dd096e8 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:53.618052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:53.618761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:53.620865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:53.621236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:53.621944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:53.624909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:53.740893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 923/1845] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:53 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:53.742092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:53.770995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b793d04-4830-44dc-908d-2ee25729680e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:53.781301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:53.782223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:53.782757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:53.784682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:53.785578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:53.787454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:53.834428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 923/1846] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:53.834579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:53.834579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d39da-d79a-4496-a7d3-5907ee670616 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:53.845741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:53.846807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:53.847174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:53.847616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] PATH_INFO: `/v3/projects/2457aef64dff4efaba10da987698983b/users/71b05fcfc207462d9301c6c2485ce173/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:53.879360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2457aef64dff4efaba10da987698983b, user_id=71b05fcfc207462d9301c6c2485ce173, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:53.883073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:53.904085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:53.906961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:53.921461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50994a33-ccd6-4d1d-b9d6-373e78028708 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:53.937411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:53.937411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:53.937411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:53.937411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] PATH_INFO: `/v3/projects/75342a1ef9e74493b871f47cfda3c0fb` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:53.938162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75342a1ef9e74493b871f47cfda3c0fb)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:53.938256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:53.966552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 924/1847] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:53 2022] PUT /identity/v3/projects/2457aef64dff4efaba10da987698983b/users/71b05fcfc207462d9301c6c2485ce173/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:52:53.970692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:54.065936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e0cb4-38e0-4f06-b426-35a4b4031b01 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:54.073134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:54.073869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:54.074316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:54.074706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:54.075532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:54.078569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:54.109845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 925/1848] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:54.112684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:54.130308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea41e4-e7a4-4f8a-932a-9a918ec49524 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:54.138443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75342a1ef9e74493b871f47cfda3c0fb', 'request_id': 'req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.152724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75342a1ef9e74493b871f47cfda3c0fb', 'request_id': 'req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.206833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52572ee6-01c9-48ac-a459-745ce2ff9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:54.208021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52572ee6-01c9-48ac-a459-745ce2ff9d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:54.208595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52572ee6-01c9-48ac-a459-745ce2ff9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:54.209034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52572ee6-01c9-48ac-a459-745ce2ff9d35 admin admin] PATH_INFO: `/v3/projects/2457aef64dff4efaba10da987698983b/users/71b05fcfc207462d9301c6c2485ce173/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:54.211524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52572ee6-01c9-48ac-a459-745ce2ff9d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2457aef64dff4efaba10da987698983b, user_id=71b05fcfc207462d9301c6c2485ce173, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:54.215306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52572ee6-01c9-48ac-a459-745ce2ff9d35 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:54.231136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 926/1849] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:54 2022] PUT /identity/v3/projects/2457aef64dff4efaba10da987698983b/users/71b05fcfc207462d9301c6c2485ce173/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:54.241199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:54.241447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:54.241716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:54.246096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75342a1ef9e74493b871f47cfda3c0fb', 'request_id': 'req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.281232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] MFA Rules not processed for user `71b05fcfc207462d9301c6c2485ce173`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:54.282512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] The token cache is being invalidate because project 75342a1ef9e74493b871f47cfda3c0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:54.283280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:54.283750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.285507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.294241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 924/1850] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:53 2022] DELETE /identity/v3/projects/75342a1ef9e74493b871f47cfda3c0fb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:54.295228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:54.296782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:54.315589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1ef4c-992b-4fc2-bb27-f3b8f486473c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:54.381988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:54.413000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 927/1851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:52:54.421088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:54.422692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:54.439447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:54.440641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:54.440770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:54.440954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] PATH_INFO: `/v3/users/e63f9a50bc2040bba9c4bc3c3a205c9b` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:54.442134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63f9a50bc2040bba9c4bc3c3a205c9b)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:54.449213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:54.488420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6897177-7bc8-4fd3-af7b-589189119a0f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:54.492338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:54.493067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:54.493459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:54.493799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:54.495912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:54.569279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:54.570832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:54.580695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 928/1852] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:54.600269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63f9a50bc2040bba9c4bc3c3a205c9b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.669632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63f9a50bc2040bba9c4bc3c3a205c9b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.670301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63f9a50bc2040bba9c4bc3c3a205c9b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.670953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63f9a50bc2040bba9c4bc3c3a205c9b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.679387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-52445dd1-1f18-419f-947f-bfccc0c3927b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63f9a50bc2040bba9c4bc3c3a205c9b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:54.698389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 925/1853] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:54 2022] DELETE /identity/v3/users/e63f9a50bc2040bba9c4bc3c3a205c9b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:54.799350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:55.248384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:55.261884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a42539-dd2f-4a8b-a8ec-00b89a673ecf service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:55.336829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:55.337502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:55.340143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:55.340143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] PATH_INFO: `/v3/projects/1cfad837797d40299dba493b836546fc` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:55.340143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfad837797d40299dba493b836546fc)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:55.341440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:55.456480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:55.518254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfad837797d40299dba493b836546fc', 'request_id': 'req-fabd1beb-8939-4456-9ec7-8a30fb536611'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:55.532692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfad837797d40299dba493b836546fc', 'request_id': 'req-fabd1beb-8939-4456-9ec7-8a30fb536611'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:55.662382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfad837797d40299dba493b836546fc', 'request_id': 'req-fabd1beb-8939-4456-9ec7-8a30fb536611'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:55.679201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] The token cache is being invalidate because project 1cfad837797d40299dba493b836546fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:55.680263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:55.680937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fabd1beb-8939-4456-9ec7-8a30fb536611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:55.683391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 929/1854] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:55 2022] DELETE /identity/v3/projects/1cfad837797d40299dba493b836546fc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:55.688918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:55.689487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:55.689932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:55.711656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:55.712913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:55.797127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 926/1855] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:55.805268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:55.805546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:55.805814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:55.827764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:55.828964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:55.836791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 930/1856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:55.841385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:55.873939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c61bc8-822e-44a9-98f2-52c0ebf90779 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:55.896851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:55.903460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:55.903460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:55.903460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:55.903460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:52:55.903460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:55.903460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:55.930054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 927/1857] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:52:55.934922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:55.945559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950b657-3caa-4da4-b8df-849adeb644ed None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:55.954652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:55.970260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:55.970927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:55.971706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:55.972530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:55.973678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:55.977630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:56.101991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 931/1858] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:55 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:56.106552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:56.116996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5427b0-1003-4c50-9519-1b42bcd6d958 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:56.183227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:56.183856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.184287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.184563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.185236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:56.187294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:56.279073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 928/1859] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:56 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:52:56.283132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:56.294185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519c528-8fd6-4c4e-b965-e59bfaf5f445 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:56.301672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:56.302496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.303037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.303489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.304330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:56.306269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:56.320367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 932/1860] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:56.324891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:56.337250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c878631-3d2a-4753-86aa-4fbdaf0a88c0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:56.342892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761054c-134a-4a5d-a018-46c2aecb1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:56.343503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761054c-134a-4a5d-a018-46c2aecb1ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.343778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761054c-134a-4a5d-a018-46c2aecb1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.344050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761054c-134a-4a5d-a018-46c2aecb1ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.344754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761054c-134a-4a5d-a018-46c2aecb1ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:56.346276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761054c-134a-4a5d-a018-46c2aecb1ed9 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:56.358841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 929/1861] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:52:56.363517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:56.377843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0f291-6dc4-4a6e-92f8-afcacbafd73b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:56.384441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:56.387299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.387461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.387782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] PATH_INFO: `/v3/projects/6537b7e269c8483aaa9ce75e7e8b8258/users/6ad31979c0d2439e8ee9a147cadd6b33/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.405654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6537b7e269c8483aaa9ce75e7e8b8258, user_id=6ad31979c0d2439e8ee9a147cadd6b33, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:56.409420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:56.477492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 933/1862] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:56 2022] PUT /identity/v3/projects/6537b7e269c8483aaa9ce75e7e8b8258/users/6ad31979c0d2439e8ee9a147cadd6b33/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:56.495553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.495553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.495553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.519596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:56.535585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] MFA Rules not processed for user `6ad31979c0d2439e8ee9a147cadd6b33`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:56.537080 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:56.614131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 930/1863] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:56.618896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:56.633244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:56.690382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc85aba-aab4-4662-89d7-555ff9781a7b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:56.696461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:56.697694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.698019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.698368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.699108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:56.701419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:56.841833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 934/1864] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:52:56 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:56.844961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:56.856684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407b47b-5827-44e5-a9e8-9df382787404 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:56.923694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:56.924313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:56.928183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:56.928183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:56.928183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:56.928183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:57.042927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 931/1865] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:52:56 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:52:57.044372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:57.055183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a3ca-6727-44a5-aaab-acb454c2a8a5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:57.060605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:57.061300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.061663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.061940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.062630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:57.064239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:57.079945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 935/1866] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:57.080986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:57.092469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ae2c-93e5-493e-a859-0251064139a8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:57.098364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:57.099225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.099564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.106368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] PATH_INFO: `/v3/projects/cf19391392d14a77819467e4331d1b1e/users/36f88acc15d14671864631a63194fe95/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.115460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf19391392d14a77819467e4331d1b1e, user_id=36f88acc15d14671864631a63194fe95, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:57.118298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:57.262245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 932/1867] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:57 2022] PUT /identity/v3/projects/cf19391392d14a77819467e4331d1b1e/users/36f88acc15d14671864631a63194fe95/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:57.266912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:57.277671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e9eeb-be95-429a-9031-4686dcd0c82d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:57.366046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838b243-472b-44f2-bb9d-c74694b3e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:57.366046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b243-472b-44f2-bb9d-c74694b3e487 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.366046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b243-472b-44f2-bb9d-c74694b3e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.366785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b243-472b-44f2-bb9d-c74694b3e487 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.367448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838b243-472b-44f2-bb9d-c74694b3e487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:57.369172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838b243-472b-44f2-bb9d-c74694b3e487 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:57.386823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 936/1868] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:52:57.390328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:57.403219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c83b-d765-46cf-a300-8258410a7d6f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:57.410830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:57.412610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.413015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.413350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] PATH_INFO: `/v3/projects/cf19391392d14a77819467e4331d1b1e/users/36f88acc15d14671864631a63194fe95/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.415601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf19391392d14a77819467e4331d1b1e, user_id=36f88acc15d14671864631a63194fe95, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:57.418882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:57.440395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 933/1869] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:52:57 2022] PUT /identity/v3/projects/cf19391392d14a77819467e4331d1b1e/users/36f88acc15d14671864631a63194fe95/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:57.444431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.445024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.445373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.479594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] MFA Rules not processed for user `36f88acc15d14671864631a63194fe95`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:57.480985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:57.485230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:57.572407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 937/1870] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:57.585297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:57.587151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:57.650499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:57.669194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28252fa-52ae-4232-81af-9f4e0c723e7b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:57.673323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b20ab-018f-42f8-af8d-8541d7edeb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:57.673943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b20ab-018f-42f8-af8d-8541d7edeb5b service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.674225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b20ab-018f-42f8-af8d-8541d7edeb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.674498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b20ab-018f-42f8-af8d-8541d7edeb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.685817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b20ab-018f-42f8-af8d-8541d7edeb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:57.688686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b20ab-018f-42f8-af8d-8541d7edeb5b service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:57.701649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 934/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:57.807837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:57.914436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee68ab-3afe-4a30-8178-413f75b42d1f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:57.920813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:57.921725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:57.922079 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:57.922512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] PATH_INFO: `/v3/users/6ad31979c0d2439e8ee9a147cadd6b33` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:57.931502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad31979c0d2439e8ee9a147cadd6b33)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:57.931502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:58.173003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad31979c0d2439e8ee9a147cadd6b33'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:58.174206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad31979c0d2439e8ee9a147cadd6b33'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:58.280888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad31979c0d2439e8ee9a147cadd6b33'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:58.284657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad31979c0d2439e8ee9a147cadd6b33'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:58.329822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad31979c0d2439e8ee9a147cadd6b33'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:58.348022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 938/1872] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:57 2022] DELETE /identity/v3/users/6ad31979c0d2439e8ee9a147cadd6b33 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:58.352303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:58.352599 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:58.352856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:58.377369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:52:58.378630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:58.505832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 935/1873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:52:58.519668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:58.520565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:58.576098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:52:58.619128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc7666-aab1-42b9-8d5c-29256edcfc9b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:58.626703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:58.627736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:58.628514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:58.629280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:58.650918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:58.663820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:58.676853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 939/1874] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:52:59.578343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:59.580008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:52:59.605449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720d57-c9cf-4996-9feb-9e54f310b99a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:52:59.629002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:52:59.629670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:52:59.630042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:52:59.630214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] PATH_INFO: `/v3/projects/6537b7e269c8483aaa9ce75e7e8b8258` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:52:59.631478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6537b7e269c8483aaa9ce75e7e8b8258)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:52:59.633388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:52:59.834936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6537b7e269c8483aaa9ce75e7e8b8258', 'request_id': 'req-3c750b66-33f8-49b0-b009-6d4f5555c86c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:59.845429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6537b7e269c8483aaa9ce75e7e8b8258', 'request_id': 'req-3c750b66-33f8-49b0-b009-6d4f5555c86c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:59.949065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6537b7e269c8483aaa9ce75e7e8b8258', 'request_id': 'req-3c750b66-33f8-49b0-b009-6d4f5555c86c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:59.961422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] The token cache is being invalidate because project 6537b7e269c8483aaa9ce75e7e8b8258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:52:59.961896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:59.962705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:52:59.964953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 936/1875] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:52:59 2022] DELETE /identity/v3/projects/6537b7e269c8483aaa9ce75e7e8b8258 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:52:59.969092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:52:59.979795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3e320-113d-40f4-9257-7ef771ac0ab6 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:00.072749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:00.080957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:00.080957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:00.080957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] PATH_INFO: `/v3/users/36f88acc15d14671864631a63194fe95` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:00.080957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f88acc15d14671864631a63194fe95)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:00.080957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:00.336843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:00.339166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:00.407470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f88acc15d14671864631a63194fe95'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:00.409744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f88acc15d14671864631a63194fe95'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:00.468514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f88acc15d14671864631a63194fe95'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:00.469879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f88acc15d14671864631a63194fe95'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:00.489609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750b66-33f8-49b0-b009-6d4f5555c86c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:00.489805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f88acc15d14671864631a63194fe95'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:00.495163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:00.498405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:00.498405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:00.498405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:00.500178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:00.519976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 940/1876] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:52:59 2022] DELETE /identity/v3/users/36f88acc15d14671864631a63194fe95 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:00.547360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:00.621230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:00.623635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e4d20-1e8c-43c7-bf68-8b33a2dbc49d service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:00.645674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 937/1877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:01.276421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:01.277785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:01.329721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:01.351497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91ddb-a7e2-453b-bb6e-6e0095a18e69 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:01.357288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:01.357980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:01.358288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:01.358622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] PATH_INFO: `/v3/projects/cf19391392d14a77819467e4331d1b1e` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:01.359782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf19391392d14a77819467e4331d1b1e)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:01.361700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:01.493011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf19391392d14a77819467e4331d1b1e', 'request_id': 'req-ed585746-3692-4ea0-9807-4474cac50490'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:01.506250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf19391392d14a77819467e4331d1b1e', 'request_id': 'req-ed585746-3692-4ea0-9807-4474cac50490'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:01.635394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf19391392d14a77819467e4331d1b1e', 'request_id': 'req-ed585746-3692-4ea0-9807-4474cac50490'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:01.681373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] The token cache is being invalidate because project cf19391392d14a77819467e4331d1b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:01.681666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:01.683161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ed585746-3692-4ea0-9807-4474cac50490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:01.685840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 941/1878] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:01 2022] DELETE /identity/v3/projects/cf19391392d14a77819467e4331d1b1e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:01.691319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:01.692044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:01.692044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:01.731248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:01.736005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:01.875485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 938/1879] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:01.877379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:01.877791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:01.882345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:01.908243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:01.910718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:01.930112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 942/1880] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:01.935163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:01.964106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2a53-4b46-47d4-8c30-417cdab3c148 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:01.973517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:01.974527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:01.975043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:01.975459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:01.999106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:01.999106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:01.999106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:01.999106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 939/1881] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:02.000228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:02.013919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1f372-05d0-4030-ad6b-cb686a90ecfa None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:02.044831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:02.045687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.046059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.046436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.047371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:02.049510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:02.194775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 943/1882] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:01 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:02.199806 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:02.211034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18e29-1174-4659-b2d4-d2a78eb7d1ee admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:02.285891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:02.286738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.287237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.287806 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.288465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:02.291939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:02.389844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 940/1883] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:02 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:02.393742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:02.408731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e5fc-5dc5-4070-ae29-873d6eb22677 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:02.413691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:02.414348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.422271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.422271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.422271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:02.422271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:02.436531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 944/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:02.440648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:02.473129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbf6ed-c8ab-465c-af03-bf284222d626 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:02.480433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70f3f-bed1-4ebb-b156-c82e2b56ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:02.481206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70f3f-bed1-4ebb-b156-c82e2b56ba83 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.481420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70f3f-bed1-4ebb-b156-c82e2b56ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.481694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70f3f-bed1-4ebb-b156-c82e2b56ba83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.482341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f70f3f-bed1-4ebb-b156-c82e2b56ba83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:02.492251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f70f3f-bed1-4ebb-b156-c82e2b56ba83 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:02.511146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 941/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:02.511854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:02.523303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217918-c069-4aef-ad12-c8705ad6a2cb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:02.528643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:02.529537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.529947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.530348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] PATH_INFO: `/v3/projects/6928e12f797f47159f7d579d3bd45f7a/users/4b811177fa7140dc80cb68884e6f826e/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.552686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6928e12f797f47159f7d579d3bd45f7a, user_id=4b811177fa7140dc80cb68884e6f826e, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:02.555637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:02.659954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 945/1886] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:02 2022] PUT /identity/v3/projects/6928e12f797f47159f7d579d3bd45f7a/users/4b811177fa7140dc80cb68884e6f826e/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:02.676225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.676508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.676780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.730399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] MFA Rules not processed for user `4b811177fa7140dc80cb68884e6f826e`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:02.730399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:02.735865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:02.832979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 942/1887] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:02.833487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:02.915277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42ca71-0930-423f-88bb-f89975a144ef admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:02.925906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:02.926600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:02.926885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:02.927159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:02.934411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:02.936712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:02.958425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:03.020384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 946/1888] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:02 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:03.025515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:03.038817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac046b4-7ef8-4748-9317-f1d5dd2a7409 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:03.111723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:03.112347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.112630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.112900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.114091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:03.115542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:03.227356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 943/1889] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:03 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:03.228867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:03.254118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41b288-25de-480f-a8f0-b4a6ba17acca admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:03.274944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:03.279763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.280522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.281421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.285016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:03.290727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:03.312943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 947/1890] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:03.313639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:03.326767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b2f2-afc8-469c-9118-383ae707df2d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:03.333821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:03.334896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.335173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.335451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] PATH_INFO: `/v3/projects/97110a09239c4996bce0ff9e07525497/users/eba62b0098344b4cae21279799868d2f/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.357256 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97110a09239c4996bce0ff9e07525497, user_id=eba62b0098344b4cae21279799868d2f, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:03.359970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:03.453801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 944/1891] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:03 2022] PUT /identity/v3/projects/97110a09239c4996bce0ff9e07525497/users/eba62b0098344b4cae21279799868d2f/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:03.457742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:03.474039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423ad3a-24c1-4e83-a656-bbbcf6d1195a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:03.565349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee43ea7-5a5c-4740-b0b7-4f536b9c4f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:03.567483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee43ea7-5a5c-4740-b0b7-4f536b9c4f04 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.567903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee43ea7-5a5c-4740-b0b7-4f536b9c4f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.568372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee43ea7-5a5c-4740-b0b7-4f536b9c4f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.569107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee43ea7-5a5c-4740-b0b7-4f536b9c4f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:03.570824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee43ea7-5a5c-4740-b0b7-4f536b9c4f04 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:03.582824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 948/1892] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:03.587606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:03.598893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3188f-e99d-431b-b376-9af25a54ac9a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:03.604666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:03.605292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.605669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.610725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] PATH_INFO: `/v3/projects/97110a09239c4996bce0ff9e07525497/users/eba62b0098344b4cae21279799868d2f/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.610725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97110a09239c4996bce0ff9e07525497, user_id=eba62b0098344b4cae21279799868d2f, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:03.610725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:03.621345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 945/1893] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:03 2022] PUT /identity/v3/projects/97110a09239c4996bce0ff9e07525497/users/eba62b0098344b4cae21279799868d2f/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:03.631744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.632029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.632302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.661467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] MFA Rules not processed for user `eba62b0098344b4cae21279799868d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:03.662762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:03.731716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 949/1894] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:03.743528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:03.746055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:03.813984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e870bf-9ede-4d8c-b1b1-81625922f613 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:03.817965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:03.818699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:03.818984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:03.819259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:03.828371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:03.829796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:03.840084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 946/1895] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:04.049330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:04.060112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795feea0-8feb-46c2-ad96-792cabf60a41 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:04.065045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f40588-991c-40c4-b3af-4d9036da9342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:04.079845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40588-991c-40c4-b3af-4d9036da9342 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:04.079845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40588-991c-40c4-b3af-4d9036da9342 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:04.079845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40588-991c-40c4-b3af-4d9036da9342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:04.148408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f40588-991c-40c4-b3af-4d9036da9342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:04.149852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f40588-991c-40c4-b3af-4d9036da9342 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:04.163523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 950/1896] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:07.011753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:07.013796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:07.037438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:07.091665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56016ca-4a3c-476c-90c1-d843f4d02f28 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:07.096984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:07.097716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:07.098044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:07.098312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] PATH_INFO: `/v3/users/adfbf9b5f39642bb8942fedddfdfb080` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:07.099504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfbf9b5f39642bb8942fedddfdfb080)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:07.101461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:07.291550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfbf9b5f39642bb8942fedddfdfb080'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:07.376305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfbf9b5f39642bb8942fedddfdfb080'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:07.376940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfbf9b5f39642bb8942fedddfdfb080'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:07.377549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfbf9b5f39642bb8942fedddfdfb080'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:07.386426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfbf9b5f39642bb8942fedddfdfb080'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:07.422702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 947/1897] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:07 2022] DELETE /identity/v3/users/adfbf9b5f39642bb8942fedddfdfb080 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:07.427524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:07.428327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:07.428738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:07.440142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:07.453856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:07.455209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:07.543101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 951/1898] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:07.567390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:07.568963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:07.653187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e516d-c23e-4c07-bfa9-aa8d7b62d613 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:07.657839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:07.658459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:07.658772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:07.659044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:07.672279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:07.673780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:07.684941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 948/1899] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:08.179540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:08.181671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:08.219104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20bdbd-1811-414f-83df-e5a87580a317 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:08.220483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:08.221071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:08.222783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:08.222783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] PATH_INFO: `/v3/projects/fbe0505ebbaf4f6ebc19974e99286ae6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:08.223004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe0505ebbaf4f6ebc19974e99286ae6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:08.225080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:08.356447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe0505ebbaf4f6ebc19974e99286ae6', 'request_id': 'req-0aa7fba9-443b-4966-9c35-a24b434abec0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.367687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe0505ebbaf4f6ebc19974e99286ae6', 'request_id': 'req-0aa7fba9-443b-4966-9c35-a24b434abec0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.439354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe0505ebbaf4f6ebc19974e99286ae6', 'request_id': 'req-0aa7fba9-443b-4966-9c35-a24b434abec0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.455555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] The token cache is being invalidate because project fbe0505ebbaf4f6ebc19974e99286ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:08.455934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.457722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.464212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 952/1900] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:08 2022] DELETE /identity/v3/projects/fbe0505ebbaf4f6ebc19974e99286ae6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:08.466887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:08.489740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7489b-2a85-4254-ae2c-51d0ed39f4fe service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:08.541012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:08.577482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:08.578237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:08.578660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:08.579044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] PATH_INFO: `/v3/users/71b05fcfc207462d9301c6c2485ce173` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:08.580368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b05fcfc207462d9301c6c2485ce173)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:08.582808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:08.841530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b05fcfc207462d9301c6c2485ce173'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.936003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b05fcfc207462d9301c6c2485ce173'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.936845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b05fcfc207462d9301c6c2485ce173'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.938178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b05fcfc207462d9301c6c2485ce173'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.948006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d15459de-e72a-41e2-8e6c-ab6e538e3e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b05fcfc207462d9301c6c2485ce173'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:08.977362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 949/1901] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:08 2022] DELETE /identity/v3/users/71b05fcfc207462d9301c6c2485ce173 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:09.508309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:09.510979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:09.532603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7fba9-443b-4966-9c35-a24b434abec0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:09.629135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:09.633845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:09.634657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:09.635399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] PATH_INFO: `/v3/projects/2457aef64dff4efaba10da987698983b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:09.642368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2457aef64dff4efaba10da987698983b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:09.644873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:09.759489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:09.794764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2457aef64dff4efaba10da987698983b', 'request_id': 'req-809e19e9-4fd2-4946-9155-9e504db90773'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:09.814957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2457aef64dff4efaba10da987698983b', 'request_id': 'req-809e19e9-4fd2-4946-9155-9e504db90773'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:09.907419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2457aef64dff4efaba10da987698983b', 'request_id': 'req-809e19e9-4fd2-4946-9155-9e504db90773'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:09.940486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] The token cache is being invalidate because project 2457aef64dff4efaba10da987698983b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:09.940986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:09.941935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-809e19e9-4fd2-4946-9155-9e504db90773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:09.946595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 953/1902] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:09 2022] DELETE /identity/v3/projects/2457aef64dff4efaba10da987698983b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:09.952019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:09.952868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:09.953292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:09.984916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:09.986673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:10.108046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 950/1903] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:10.121811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.122081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.122434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.165839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:10.167152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:10.180448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 954/1904] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:10.184603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:10.198705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ea57-062b-4ced-b3e9-07055f454d1b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:10.215232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:10.216129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.216512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.216891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.217654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:10.218059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:10.219860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:10.245673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 951/1905] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:10.246702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:10.261575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffebc4f-1568-4635-b346-080d29f22b21 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:10.267429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:10.268264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.268779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.269458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.270897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:10.273461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:10.396299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 955/1906] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:10 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:10.401620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:10.429334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf988a0c-24b0-4d18-845d-48ce40cf9282 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:10.472910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:10.512087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:10.512788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.513518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.514064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.514868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:10.516750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:10.778152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:10.780610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 952/1907] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:10 2022] POST /identity/v3/users => generated 288 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:10.864527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859afae-3e31-4cc8-8339-5baf990fb266 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:10.864527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:10.864527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.864527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.866424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.866424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:10.866424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:10.866424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 956/1908] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:10.866767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:10.866767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e277-cb63-4ea1-857f-2ca1a5810464 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:10.866767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42bc81-3198-4929-9bf1-54b553a38fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:10.866767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bc81-3198-4929-9bf1-54b553a38fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.880085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bc81-3198-4929-9bf1-54b553a38fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.880581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bc81-3198-4929-9bf1-54b553a38fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.881299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42bc81-3198-4929-9bf1-54b553a38fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:10.886076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42bc81-3198-4929-9bf1-54b553a38fa2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:10.908314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 953/1909] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:10.914282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:10.933054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cbdbf-1f5f-463e-9ea5-0fa4c6f9c53c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:10.951672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:10.952741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:10.953719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:10.954652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] PATH_INFO: `/v3/projects/b63c77e53d324040af796f074bf373db/users/039ef5a7c9294b8384831ca929f889f8/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:10.977811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63c77e53d324040af796f074bf373db, user_id=039ef5a7c9294b8384831ca929f889f8, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:10.982519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:11.299872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 957/1910] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:10 2022] PUT /identity/v3/projects/b63c77e53d324040af796f074bf373db/users/039ef5a7c9294b8384831ca929f889f8/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:11.312810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.313250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.313250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.350592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] MFA Rules not processed for user `039ef5a7c9294b8384831ca929f889f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:11.351928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:11.440977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 954/1911] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:11.450492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.470051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.471714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:11.522964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e80ae8-8ac3-464b-844d-74669507b2dd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:11.528339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:11.528979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.529259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.529529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.530183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:11.532166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:11.545725 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5f54-1307-40cb-9f43-c8a7687ac98e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:11.549667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:11.550289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.550595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.550914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] PATH_INFO: `/v3/users/4b811177fa7140dc80cb68884e6f826e` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.552211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b811177fa7140dc80cb68884e6f826e)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:11.554197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:11.644033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 958/1912] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:11 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:11.645189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.690144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:11.711450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b67d9-9bce-4f06-a2a3-0df0b0d06e06 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:11.714724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:11.716366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b811177fa7140dc80cb68884e6f826e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:11.716647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:11.717568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.717702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.717909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.718872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:11.720931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:11.810295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b811177fa7140dc80cb68884e6f826e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:11.810940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b811177fa7140dc80cb68884e6f826e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:11.811636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b811177fa7140dc80cb68884e6f826e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:11.816495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 959/1913] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:11 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:11.820426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.821999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:11.822754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-068a4a4f-8ba0-437c-8c15-4a9446adac40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b811177fa7140dc80cb68884e6f826e'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:11.834017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d36a-e1fe-4040-a96d-71ae5b3c9c07 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:11.839450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:11.840048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.840330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.840602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.841243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:11.842448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 955/1914] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:11 2022] DELETE /identity/v3/users/4b811177fa7140dc80cb68884e6f826e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:11.842882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:11.847139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.847429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.847798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.858095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 960/1915] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:11.865373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.868827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:11.870537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:11.877628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff7b15-3300-4df9-8dd9-6f3f9bcb9beb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:11.941047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 956/1916] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:11.943731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:11.944798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.944798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.944979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.945557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:11.947266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:11.950651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.952050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:11.958312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 961/1917] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:11.962576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:11.973364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3fa6f-f088-4c62-b995-f6dd18220d14 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:11.978046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:11.979276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:11.979562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:11.979831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] PATH_INFO: `/v3/projects/425052d9bec049698b2d3f898e255eac/users/d9ee7b1149f74c3d9cb08bf4d718a89d/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:11.996342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425052d9bec049698b2d3f898e255eac, user_id=d9ee7b1149f74c3d9cb08bf4d718a89d, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:11.999040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.013191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a60152-f446-4da3-956a-43d3f0a86c25 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.017305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748a28-0876-4fd6-92c0-444cc1238311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.017939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748a28-0876-4fd6-92c0-444cc1238311 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.018213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748a28-0876-4fd6-92c0-444cc1238311 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.018503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748a28-0876-4fd6-92c0-444cc1238311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.028534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748a28-0876-4fd6-92c0-444cc1238311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.037603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748a28-0876-4fd6-92c0-444cc1238311 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.043057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 957/1918] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:12.082810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 962/1919] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:11 2022] PUT /identity/v3/projects/425052d9bec049698b2d3f898e255eac/users/d9ee7b1149f74c3d9cb08bf4d718a89d/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:12.095160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.095980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.095980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.132229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] MFA Rules not processed for user `d9ee7b1149f74c3d9cb08bf4d718a89d`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:12.133434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:12.201135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:12.210393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 958/1920] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:12.215811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.314670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d15fea-3548-4239-be01-bf8d8184cf66 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.323063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.323795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.324150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.324795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.325242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.327340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.413601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.415389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 963/1921] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:12 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:12.429046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4166894-8b33-4426-aa4d-e30f3fa00a6f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.495689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.496497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.496851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.497197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.497898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.499929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.604378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 959/1922] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:12 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:12.607536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.609432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:12.612969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.626332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971027-eb20-4c7a-8c28-74b445bc2535 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.634159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cda487-2562-4bfe-8234-f5dbe2b47cfd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.640158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.640809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.641091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.641385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] PATH_INFO: `/v3/projects/6928e12f797f47159f7d579d3bd45f7a` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.642492 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.642776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6928e12f797f47159f7d579d3bd45f7a)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.643958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.644576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.644696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.645375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.646233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.648099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.655920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:12.665168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 960/1923] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:12.666399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.677593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782ddf-932c-4ca7-9cac-76e7a351f187 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.683175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.684272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.684272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.684516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] PATH_INFO: `/v3/projects/714f2e96557c4b9ebd4f3ac4559f2878/users/398313e8866d442e9ab4e50ff3f21e14/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.701662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714f2e96557c4b9ebd4f3ac4559f2878, user_id=398313e8866d442e9ab4e50ff3f21e14, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.704350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.842544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 961/1924] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:12 2022] PUT /identity/v3/projects/714f2e96557c4b9ebd4f3ac4559f2878/users/398313e8866d442e9ab4e50ff3f21e14/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:12.846433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.849638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6928e12f797f47159f7d579d3bd45f7a', 'request_id': 'req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:12.857613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6928e12f797f47159f7d579d3bd45f7a', 'request_id': 'req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:12.911335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb02b3b-9afc-4e6a-8d10-8d4fa7f63483 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:12.929905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6928e12f797f47159f7d579d3bd45f7a', 'request_id': 'req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:12.942164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] The token cache is being invalidate because project 6928e12f797f47159f7d579d3bd45f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:12.942577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:12.943292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:12.945446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 964/1925] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:12 2022] DELETE /identity/v3/projects/6928e12f797f47159f7d579d3bd45f7a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:12.949310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.950831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:12.965800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:12.971735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:12.972493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:12.972778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:12.973049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:12.973699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:12.975355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:12.989353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 962/1926] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:12.990374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:12.992446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:13.007052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21ed37-2a58-4cfb-a248-c5004264d321 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:13.011838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18f5be-1592-419a-bea0-d69acd9a8308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:13.012529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f5be-1592-419a-bea0-d69acd9a8308 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:13.012810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f5be-1592-419a-bea0-d69acd9a8308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:13.013078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f5be-1592-419a-bea0-d69acd9a8308 admin admin] PATH_INFO: `/v3/projects/714f2e96557c4b9ebd4f3ac4559f2878/users/398313e8866d442e9ab4e50ff3f21e14/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:13.015009 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f5be-1592-419a-bea0-d69acd9a8308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714f2e96557c4b9ebd4f3ac4559f2878, user_id=398313e8866d442e9ab4e50ff3f21e14, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:13.017615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f5be-1592-419a-bea0-d69acd9a8308 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:13.022606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a5bc-7e7f-4e1d-b75b-b11070aeddad admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:13.027797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 963/1927] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:12 2022] PUT /identity/v3/projects/714f2e96557c4b9ebd4f3ac4559f2878/users/398313e8866d442e9ab4e50ff3f21e14/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:13.038108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:13.038442 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:13.038769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:13.070108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] MFA Rules not processed for user `398313e8866d442e9ab4e50ff3f21e14`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:13.071436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:13.090626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:13.090626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:13.090626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:13.090626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] PATH_INFO: `/v3/users/eba62b0098344b4cae21279799868d2f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:13.092683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba62b0098344b4cae21279799868d2f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:13.092683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:13.144186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 964/1928] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:13.155991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:13.157369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:13.214747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f02c4-3486-4e0d-8461-cd7673f16a8f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:13.218279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:13.218989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:13.219261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:13.219528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:13.221270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:13.281525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:13.283209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:13.287373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:13.289658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba62b0098344b4cae21279799868d2f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:13.290327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba62b0098344b4cae21279799868d2f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:13.293748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 965/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:13.370885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba62b0098344b4cae21279799868d2f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:13.372154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba62b0098344b4cae21279799868d2f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:13.394254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-75dac5c0-7459-47fe-b3d6-d9288af3602a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba62b0098344b4cae21279799868d2f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:13.410541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 965/1930] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:12 2022] DELETE /identity/v3/users/eba62b0098344b4cae21279799868d2f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:13.870813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:13.882882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad084b2-2e3c-48fa-9583-4d214d484bf7 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:13.902772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:13.973603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:13.974343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:13.974625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:13.974847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] PATH_INFO: `/v3/projects/97110a09239c4996bce0ff9e07525497` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:13.991601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97110a09239c4996bce0ff9e07525497)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:13.994360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.118209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97110a09239c4996bce0ff9e07525497', 'request_id': 'req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.132515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97110a09239c4996bce0ff9e07525497', 'request_id': 'req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.199085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97110a09239c4996bce0ff9e07525497', 'request_id': 'req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.210587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] The token cache is being invalidate because project 97110a09239c4996bce0ff9e07525497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:14.210817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.211447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3892caa5-1dbf-4e9b-b0f9-b03aab23b342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.213808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 966/1931] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:13 2022] DELETE /identity/v3/projects/97110a09239c4996bce0ff9e07525497 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:14.218651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.219128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.219231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.240749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:14.241980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:14.307234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 966/1932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:14.314218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.314653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.315076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.340411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:14.341758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:14.350992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 967/1933] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:14.356356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.365828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acbf8e-9764-46fc-9c08-6fb5622a2a7a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.371969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.372585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.372868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.373454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.374106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:14.374416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.376247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.389617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 967/1934] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:14.394052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.406021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5212-24a8-4d00-806d-931c6b3249f2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.411758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.412395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.412642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.412910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.413548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.416386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.555480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 968/1935] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:14 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:14.559760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.573042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7692442-98e4-4caf-8ee8-8897967f2e7b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.627248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.629269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:14.632283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.632900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.633176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.633445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.634083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.636584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.643000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5a436-bd2c-4292-bb3f-a29678fd18d2 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.647842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.648497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.648779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.649050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] PATH_INFO: `/v3/users/52e3eb4bef43499baf3965631515ded0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.650180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e3eb4bef43499baf3965631515ded0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.652905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.752888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 968/1936] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:14 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:14.756963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.767636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906a2e0-d41c-463f-a49f-cad89e202494 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.774097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.779859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.779859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.779859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.779859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.779859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.790901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 969/1937] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:14.795120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.805078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cad4e-541b-4e58-85f0-ae06ac6cef45 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.811511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.812115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.812397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.812672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.813335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.815002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.826362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 970/1938] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:14.830435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:14.840693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d935b9f-ad14-4b75-bd43-bb1e9280c57d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:14.845333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf54e57-a902-4669-bad3-853b97948f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:14.845978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf54e57-a902-4669-bad3-853b97948f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.846252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf54e57-a902-4669-bad3-853b97948f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.846550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf54e57-a902-4669-bad3-853b97948f13 admin admin] PATH_INFO: `/v3/projects/822b567751c044c0a0e9529d72d4335f/users/182c75a896c6432380642187ca9b3f48/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.864268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf54e57-a902-4669-bad3-853b97948f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822b567751c044c0a0e9529d72d4335f, user_id=182c75a896c6432380642187ca9b3f48, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:14.867412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf54e57-a902-4669-bad3-853b97948f13 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:14.870330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:14.873500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e3eb4bef43499baf3965631515ded0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.958356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e3eb4bef43499baf3965631515ded0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.959025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e3eb4bef43499baf3965631515ded0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.959628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e3eb4bef43499baf3965631515ded0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.964713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 971/1939] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:14 2022] PUT /identity/v3/projects/822b567751c044c0a0e9529d72d4335f/users/182c75a896c6432380642187ca9b3f48/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:14.973191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d03a31d9-b666-4b68-9b15-a6dc620ea4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e3eb4bef43499baf3965631515ded0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:14.975673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.975960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.979905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:14.984339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:14.995050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 969/1940] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:14 2022] DELETE /identity/v3/users/52e3eb4bef43499baf3965631515ded0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:14.996505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:14.996793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:14.997130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.006225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] MFA Rules not processed for user `182c75a896c6432380642187ca9b3f48`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:15.007508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.018244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:15.019646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.094115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 970/1941] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:15.105066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.113927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.125536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 972/1942] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:15.129072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.130440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.144758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff39b67-cd4a-45ee-91a4-48c255f5d01f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.149375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.149979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.150254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.150696 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.151501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.153420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.191965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c31f86-e74f-4321-b8f1-3b1ef2e3508e None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.196523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.196523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.196723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.196812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.208704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.211275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.221018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 971/1943] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:15.238860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 973/1944] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:15 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:15.239267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.245137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38e6a9-8889-4929-b1bd-59c9da35b9d2 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.323530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.326060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.335980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.339205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.339205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.339205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.339852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.342305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.394284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca8bd-82a5-491a-943e-e8f8e39325e6 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.397888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.398542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.398828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.399099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.402285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.442878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 972/1945] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:15 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:15.443864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.465643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d6df4-77bf-4a64-b290-aa17f4526f64 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.471907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.473103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.473534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.478030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.478030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.478030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.487111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.488710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.489475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 973/1946] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:15.494592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.507834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f4a9-a420-40c6-8de0-7c9b5e95cd2d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.513568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.514591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.514935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.515272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] PATH_INFO: `/v3/projects/96c4954c6ba7412f9c290ba99c54c288/users/504148dcda74420388b4ea20c21ee55b/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.527706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 974/1947] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:15.530867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:15.534902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c4954c6ba7412f9c290ba99c54c288, user_id=504148dcda74420388b4ea20c21ee55b, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.538098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.609503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 974/1948] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:15 2022] PUT /identity/v3/projects/96c4954c6ba7412f9c290ba99c54c288/users/504148dcda74420388b4ea20c21ee55b/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:15.612411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.627600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157383-3fcb-4b13-9600-ddfe5ae0ca95 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.645946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:15.695085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.695846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.696133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.696398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.697033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.699606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.710510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.713625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.728816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 975/1949] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:15.733173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.735898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff26f-06f7-4328-b19b-e1020e763c04 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.743025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.743656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.744083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.744924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] PATH_INFO: `/v3/projects/b0c7f15337ee436d9f7b61e6555948fe` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.746240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c7f15337ee436d9f7b61e6555948fe)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.747576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440a54f-324b-4209-919a-4a8efeff39b4 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:15.748550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.753058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5a222-06b8-4d55-89ae-ee14c98a26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:15.753863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5a222-06b8-4d55-89ae-ee14c98a26c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.754256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5a222-06b8-4d55-89ae-ee14c98a26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.754655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5a222-06b8-4d55-89ae-ee14c98a26c3 admin admin] PATH_INFO: `/v3/projects/96c4954c6ba7412f9c290ba99c54c288/users/504148dcda74420388b4ea20c21ee55b/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.757714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5a222-06b8-4d55-89ae-ee14c98a26c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c4954c6ba7412f9c290ba99c54c288, user_id=504148dcda74420388b4ea20c21ee55b, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:15.761283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5a222-06b8-4d55-89ae-ee14c98a26c3 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:15.774514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 976/1950] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:15 2022] PUT /identity/v3/projects/96c4954c6ba7412f9c290ba99c54c288/users/504148dcda74420388b4ea20c21ee55b/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:15.784200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:15.784758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:15.785035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:15.817912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] MFA Rules not processed for user `504148dcda74420388b4ea20c21ee55b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:15.819748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.870875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c7f15337ee436d9f7b61e6555948fe', 'request_id': 'req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:15.879553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c7f15337ee436d9f7b61e6555948fe', 'request_id': 'req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:15.909337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 977/1951] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:15.926917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.929056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:15.959146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c7f15337ee436d9f7b61e6555948fe', 'request_id': 'req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:15.973312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] The token cache is being invalidate because project b0c7f15337ee436d9f7b61e6555948fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:15.973609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:15.976333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:15.976333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 975/1952] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:15 2022] DELETE /identity/v3/projects/b0c7f15337ee436d9f7b61e6555948fe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:15.980649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:15.982024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:16.012599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d046c-6b0d-433b-8583-38967fa76349 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:16.059660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab16a-c2fa-4eaf-8ee1-f110f5f6ff78 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:16.064758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:16.065404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:16.065890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:16.066327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] PATH_INFO: `/v3/users/a100123771864754bb9006ec265f3989` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:16.069502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a100123771864754bb9006ec265f3989)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:16.071612 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:16.076768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:16.078409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:16.079305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:16.079750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:16.082737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:16.162515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:16.163883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:16.174588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 978/1953] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:16.293454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a100123771864754bb9006ec265f3989'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:16.324840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:16.326542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:16.349605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd82d-2e5b-480b-b6d1-b5881773c2f0 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:16.353545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a100123771864754bb9006ec265f3989'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:16.357595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a100123771864754bb9006ec265f3989'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:16.357595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a100123771864754bb9006ec265f3989'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:16.357773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:16.358583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:16.362685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:16.363662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:16.365343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:16.365760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a100123771864754bb9006ec265f3989'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:16.392862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 976/1954] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:15 2022] DELETE /identity/v3/users/a100123771864754bb9006ec265f3989 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:16.489313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:16.491173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:16.508024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 979/1955] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:16.639176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:16.781887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:16.933719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:16.935268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.039459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03893eb-c581-40ec-a759-7da60154a9f6 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:17.046579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:17.047345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.047678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.048027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] PATH_INFO: `/v3/projects/08e0a0146a294154891dda1f1ed61a7c` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.049272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e0a0146a294154891dda1f1ed61a7c)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:17.051647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:17.136820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:17.138613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.160645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373dfa8-07ae-4a36-99b7-8b43afbdb83c service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:17.169170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:17.169992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.170343 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.170860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] PATH_INFO: `/v3/users/182c75a896c6432380642187ca9b3f48` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.172547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182c75a896c6432380642187ca9b3f48)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:17.175260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:17.199064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e0a0146a294154891dda1f1ed61a7c', 'request_id': 'req-5e53163f-59e2-4c5a-822f-1de1660f7fba'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.216396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e0a0146a294154891dda1f1ed61a7c', 'request_id': 'req-5e53163f-59e2-4c5a-822f-1de1660f7fba'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.284241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e0a0146a294154891dda1f1ed61a7c', 'request_id': 'req-5e53163f-59e2-4c5a-822f-1de1660f7fba'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.304512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] The token cache is being invalidate because project 08e0a0146a294154891dda1f1ed61a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:17.305089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.306016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.308482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 977/1956] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:16 2022] DELETE /identity/v3/projects/08e0a0146a294154891dda1f1ed61a7c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:17.309608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:17.319607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.397968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53163f-59e2-4c5a-822f-1de1660f7fba admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:17.402054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:17.402695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.403155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.403574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.405490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.437994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182c75a896c6432380642187ca9b3f48'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.438956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182c75a896c6432380642187ca9b3f48'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.484799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:17.488007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720614-82ec-4f3e-9a78-83132a7fd618 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:17.502284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 978/1957] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:17.511128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe90b95-a4b9-472a-9a31-d5f3ad94343f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.511128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe90b95-a4b9-472a-9a31-d5f3ad94343f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.511128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe90b95-a4b9-472a-9a31-d5f3ad94343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.528083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ebe90b95-a4b9-472a-9a31-d5f3ad94343f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:17.529865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ebe90b95-a4b9-472a-9a31-d5f3ad94343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.576118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182c75a896c6432380642187ca9b3f48'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.577216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182c75a896c6432380642187ca9b3f48'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.590817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-742461e8-809a-435b-8053-6f8f82a34a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182c75a896c6432380642187ca9b3f48'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:17.605559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 980/1958] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:17 2022] DELETE /identity/v3/users/182c75a896c6432380642187ca9b3f48 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:17.610031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.610420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.610782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.630576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 979/1959] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:17.632739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.633224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.633507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.635653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:17.636942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.668551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:17.670579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.709078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:17.713943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 981/1960] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:17.729488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:17.736115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:17.757060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 980/1961] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:17.764148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:17.777395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6018-4b82-45dc-a02d-008f236b303f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:17.782987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:17.783950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.784334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.785004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.785803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:17.786874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:17.793463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:17.806383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 981/1962] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:17.808512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:17.824741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7632-2c2b-4f25-b306-9b0fdac56558 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:17.828684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:17.829468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.829803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.830513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.830620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af71f2-ee80-40dc-8376-43c6dac00ac0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:17.842919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:17.845204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:17.847103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:17.847844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:17.848228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:17.848786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:17.849641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:17.862731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:17.862853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 982/1963] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:17.967541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 982/1964] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:17 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:17.972054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:17.988776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ca8d-ae8f-4f17-92f6-59fde9ecf3ff service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.022765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:18.057995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.058664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.060256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.060256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.060723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.062826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.149263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 983/1965] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:17 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:18.153106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.164594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41217e7-afd1-435d-9fe3-12cd743173b2 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.174034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.174034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.174034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.174306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.174895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.176627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.188393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 983/1966] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:18.192786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.204469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592d836-32cd-4c88-9203-c5c1e90a02f4 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.209471 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.210085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.210352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.210748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.211324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.212913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.224216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 984/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:18.229212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.240196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b54c6-be48-4b8f-8df2-8b4dc9e79db5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.245632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd382b63-6433-4aef-a9d1-036a9722e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.246293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd382b63-6433-4aef-a9d1-036a9722e7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.246611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd382b63-6433-4aef-a9d1-036a9722e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.246888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd382b63-6433-4aef-a9d1-036a9722e7ee admin admin] PATH_INFO: `/v3/projects/e424c8a734c946bca01c577fc4c63a9a/users/2764739e0cde45729ae9835dbaaf1d48/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.261779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd382b63-6433-4aef-a9d1-036a9722e7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e424c8a734c946bca01c577fc4c63a9a, user_id=2764739e0cde45729ae9835dbaaf1d48, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.264469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd382b63-6433-4aef-a9d1-036a9722e7ee admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.318325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.322683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:18.347342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8122-34d5-4ce7-ad83-10bb471f8d69 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.358549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.359217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.359490 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.359785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] PATH_INFO: `/v3/projects/822b567751c044c0a0e9529d72d4335f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.360974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822b567751c044c0a0e9529d72d4335f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.363261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.374187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 984/1968] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:18 2022] PUT /identity/v3/projects/e424c8a734c946bca01c577fc4c63a9a/users/2764739e0cde45729ae9835dbaaf1d48/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:18.386099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.386524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.386907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.426864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] MFA Rules not processed for user `2764739e0cde45729ae9835dbaaf1d48`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:18.430198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:18.501301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822b567751c044c0a0e9529d72d4335f', 'request_id': 'req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:18.509689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822b567751c044c0a0e9529d72d4335f', 'request_id': 'req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:18.523751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 985/1969] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:18.529454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.604818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf13f-49ba-4fb3-be27-ae1bdf0c6762 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.616665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822b567751c044c0a0e9529d72d4335f', 'request_id': 'req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:18.632764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] The token cache is being invalidate because project 822b567751c044c0a0e9529d72d4335f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:18.633825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:18.634142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:18.643835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 985/1970] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:18 2022] DELETE /identity/v3/projects/822b567751c044c0a0e9529d72d4335f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:18.647327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.647327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:18.688769 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.689394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.689679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.689980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.690713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.692779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.732048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c45da2-3b19-4a0d-a7ff-a8935e90ecd9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.737397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.738027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.738306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.738617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] PATH_INFO: `/v3/users/504148dcda74420388b4ea20c21ee55b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.739758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504148dcda74420388b4ea20c21ee55b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.741674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.796345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 986/1971] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:18 2022] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:18.800396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:18.802076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:18.889358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191275d-8f84-495b-a039-74d3bb4f1c33 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:18.894744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:18.895373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:18.895762 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:18.895937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:18.896583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:18.898534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:18.941837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504148dcda74420388b4ea20c21ee55b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:18.943670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504148dcda74420388b4ea20c21ee55b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:19.017314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 987/1972] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:18 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:19.021223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.021904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504148dcda74420388b4ea20c21ee55b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:19.024376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:19.025024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504148dcda74420388b4ea20c21ee55b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:19.044590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504148dcda74420388b4ea20c21ee55b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:19.048929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486ac1c-f546-48e1-bdeb-0f9c75541ef5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.061874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.062105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 986/1973] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:18 2022] DELETE /identity/v3/users/504148dcda74420388b4ea20c21ee55b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:19.064037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.066001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.066986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.069351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.073352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.103065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 988/1974] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:19.108125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.110080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:19.142235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:19.190322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303ffe-6f60-483b-b5e4-affcb0cb84e1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.199660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.200550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.200832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.201108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] PATH_INFO: `/v3/projects/27cc80789fbf4077938358f3964f9f22/users/74704cf0753c48859db145aa609cc1a7/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.217197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cc80789fbf4077938358f3964f9f22, user_id=74704cf0753c48859db145aa609cc1a7, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.219871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.312185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 987/1975] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:19 2022] PUT /identity/v3/projects/27cc80789fbf4077938358f3964f9f22/users/74704cf0753c48859db145aa609cc1a7/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:19.316226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.331436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c6712-3cde-435e-a45d-965ed1a8c3c3 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.430573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a428290-1a89-410f-b056-8489bbc53b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.432840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a428290-1a89-410f-b056-8489bbc53b1f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.435357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a428290-1a89-410f-b056-8489bbc53b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.435793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a428290-1a89-410f-b056-8489bbc53b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.436617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a428290-1a89-410f-b056-8489bbc53b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.439158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a428290-1a89-410f-b056-8489bbc53b1f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.454485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 989/1976] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:19.458844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.470034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0adf2e-ea9c-4f7d-9a10-781b0be72b7d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.477708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849fcc7-4519-4b1d-9523-9811f4f3de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.477708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849fcc7-4519-4b1d-9523-9811f4f3de3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.477708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849fcc7-4519-4b1d-9523-9811f4f3de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.477708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849fcc7-4519-4b1d-9523-9811f4f3de3c admin admin] PATH_INFO: `/v3/projects/27cc80789fbf4077938358f3964f9f22/users/74704cf0753c48859db145aa609cc1a7/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.480120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849fcc7-4519-4b1d-9523-9811f4f3de3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cc80789fbf4077938358f3964f9f22, user_id=74704cf0753c48859db145aa609cc1a7, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.483172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849fcc7-4519-4b1d-9523-9811f4f3de3c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.497507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 988/1977] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:19 2022] PUT /identity/v3/projects/27cc80789fbf4077938358f3964f9f22/users/74704cf0753c48859db145aa609cc1a7/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:19.507773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.508030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.508335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.524661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:19.540158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] MFA Rules not processed for user `74704cf0753c48859db145aa609cc1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:19.541338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:19.581670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1850bb-7be1-4349-9874-724fc9a3a21e None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.582053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1850bb-7be1-4349-9874-724fc9a3a21e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.582382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1850bb-7be1-4349-9874-724fc9a3a21e None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.586633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 989/1978] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:53:19.617671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.617950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.618639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.658983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:19.660658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:19.688843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 990/1979] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:19.690094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.692543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:19.753826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 990/1980] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:53:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:19.754908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.757153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:19.779069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:19.788840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc83b9-36ac-40cd-9758-cd36fd5c1249 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.796300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.797088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.797474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.797832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] PATH_INFO: `/v3/projects/96c4954c6ba7412f9c290ba99c54c288` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.799127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c4954c6ba7412f9c290ba99c54c288)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.802151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.850106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b55b1a-1c19-4aa7-ade8-053a790e975e None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.854426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.857854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.857854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.857854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.866179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.867725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.882862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 991/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:19.883639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:19.885077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:19.900678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213113e9-019d-440c-973f-d3d64e5cd38a service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:19.906436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:19.907127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:19.909459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:19.909459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] PATH_INFO: `/v3/users/0b632f0be1ea46278a685170f899219f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:19.909459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b632f0be1ea46278a685170f899219f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:19.911129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:19.948696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c4954c6ba7412f9c290ba99c54c288', 'request_id': 'req-0de1e7fc-888a-4b97-97c2-31edec63497d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:19.954786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c4954c6ba7412f9c290ba99c54c288', 'request_id': 'req-0de1e7fc-888a-4b97-97c2-31edec63497d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.049926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c4954c6ba7412f9c290ba99c54c288', 'request_id': 'req-0de1e7fc-888a-4b97-97c2-31edec63497d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.061032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] The token cache is being invalidate because project 96c4954c6ba7412f9c290ba99c54c288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:20.061323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.061962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.063542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 991/1982] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:19 2022] DELETE /identity/v3/projects/96c4954c6ba7412f9c290ba99c54c288 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:20.064307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.065632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.089768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b632f0be1ea46278a685170f899219f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.090566 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b632f0be1ea46278a685170f899219f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.142779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e7fc-888a-4b97-97c2-31edec63497d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.148047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.148661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.148941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.149213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.151576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.152888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b632f0be1ea46278a685170f899219f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.153596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b632f0be1ea46278a685170f899219f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.164136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.165718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d043cc-39be-4bc4-b62e-dcba2bde27ee service placement] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.166742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b632f0be1ea46278a685170f899219f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.175896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 992/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:20.177104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7f773-5f2f-4855-bfb9-13313ea24dba None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.177392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7f773-5f2f-4855-bfb9-13313ea24dba None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.177666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7f773-5f2f-4855-bfb9-13313ea24dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.188595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 992/1984] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:19 2022] DELETE /identity/v3/users/0b632f0be1ea46278a685170f899219f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:20.189419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.190764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.199065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b9a7f773-5f2f-4855-bfb9-13313ea24dba None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:20.200389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b9a7f773-5f2f-4855-bfb9-13313ea24dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.270861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc17b-7ab8-4caf-bec9-bbd1c3a673be admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.272329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 993/1985] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:20.274855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.276071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.279286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.279286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.279286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.281105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.281402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.281942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.303458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:20.304677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.314634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 994/1986] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:20.318816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.329690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262bb5a-3b60-4129-aa52-9a1ab959f50d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.337013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.337755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.338536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.342348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.342348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:20.342348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.342348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.349882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.351681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.360770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 995/1987] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:20.361959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 993/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:20.362178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.376596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65d667-602a-4861-98df-8feef6ee8e63 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.382252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.383045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.383406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.383754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.384490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.387379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.465015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.466261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:20.469947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 996/1989] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:20 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:20.471857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.482917 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474bf7-40b6-4725-8069-ea3e9b73c9ee service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.552636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c2cb-ce1d-45b7-b44b-916799d66e57 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.557762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.558288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.558397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.558711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.558841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.558985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] PATH_INFO: `/v3/projects/682cba1c702447d487152bfed740f1d8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.559129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.559524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.560123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=682cba1c702447d487152bfed740f1d8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.560324 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.561929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:20.562057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.564395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.662179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 997/1990] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:20 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:20.666436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.677076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadda32a-4938-42d2-8874-621bbf164197 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.682118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.682776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.683051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.683317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.683954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.685527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.690494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:20.696692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 998/1991] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:20.700934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.712451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd70c-fdab-46d2-a986-484366607a9d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.720769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682cba1c702447d487152bfed740f1d8', 'request_id': 'req-38dd0267-5d66-473e-be6b-9fb7c66d8f61'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.727244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682cba1c702447d487152bfed740f1d8', 'request_id': 'req-38dd0267-5d66-473e-be6b-9fb7c66d8f61'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:20.768213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.768835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.769096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.769364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.769992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.771782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:20.782122 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 999/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:20.786655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:20.795796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18ae2-8d42-4543-9edd-2f566833deb1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:20.800283 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c303c-3f0d-4a8b-983c-cb1315a82a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:20.800927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c303c-3f0d-4a8b-983c-cb1315a82a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:20.801205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c303c-3f0d-4a8b-983c-cb1315a82a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:20.801477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c303c-3f0d-4a8b-983c-cb1315a82a6b admin admin] PATH_INFO: `/v3/projects/8272bda972734f81b0d73140f55813b6/users/078950da201047fe9160335aed152a66/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:20.816291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c303c-3f0d-4a8b-983c-cb1315a82a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8272bda972734f81b0d73140f55813b6, user_id=078950da201047fe9160335aed152a66, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:20.818896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c303c-3f0d-4a8b-983c-cb1315a82a6b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.251263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682cba1c702447d487152bfed740f1d8', 'request_id': 'req-38dd0267-5d66-473e-be6b-9fb7c66d8f61'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:21.261118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1000/1993] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:20 2022] PUT /identity/v3/projects/8272bda972734f81b0d73140f55813b6/users/078950da201047fe9160335aed152a66/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:21.271804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.272090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.272364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.276752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] The token cache is being invalidate because project 682cba1c702447d487152bfed740f1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:21.277111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:21.278147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-38dd0267-5d66-473e-be6b-9fb7c66d8f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:21.280799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 994/1994] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:20 2022] DELETE /identity/v3/projects/682cba1c702447d487152bfed740f1d8 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:21.285796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6bc18-ceee-47e6-8171-da81c4a05107 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.286634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6bc18-ceee-47e6-8171-da81c4a05107 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.286634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6bc18-ceee-47e6-8171-da81c4a05107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.324969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-20c6bc18-ceee-47e6-8171-da81c4a05107 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:21.326189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-20c6bc18-ceee-47e6-8171-da81c4a05107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:21.331586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] MFA Rules not processed for user `078950da201047fe9160335aed152a66`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:21.333094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:21.406525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 995/1995] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:21.414768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.415077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.415344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.423153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1001/1996] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:21.439354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.439354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:21.439562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:21.439562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:21.446970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 996/1997] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:21.451250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.460391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a6883-c6eb-40ab-a5aa-91c2bbe37031 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.465165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.465751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.466024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.473794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.473794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:21.473794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:21.473794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.481518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 997/1998] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:21.485676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.496637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf315-84d3-4dae-a01e-2dd9856cef36 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.496837 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca894f25-87b0-4960-8188-7e60dee007be admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.500445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.505497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.505497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.505497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.505784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.505784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.505784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.505784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.506134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:21.506134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.510096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:21.511671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.521755 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1002/1999] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:21.700430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 998/2000] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:21 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:21.704569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.715794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4eaa32-6374-4914-be2f-2d4605e8a742 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.772925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.773722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.773841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.774066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.774722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:21.776817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.907932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1003/2001] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:21 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:21.912043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.923305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459bd1e-f1a2-44f9-b16a-8fddc87fe428 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.927975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.928574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.928879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.929150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.929786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:21.931418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.942266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 999/2002] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:21.946203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.957142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e5ad3-bfd5-4c20-be15-b9d132db7c63 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.961812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83e85f-53b9-4940-84c3-401b105ee05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.962401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e85f-53b9-4940-84c3-401b105ee05c admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.962744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e85f-53b9-4940-84c3-401b105ee05c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.963639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e85f-53b9-4940-84c3-401b105ee05c admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:21.964282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83e85f-53b9-4940-84c3-401b105ee05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:21.965858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83e85f-53b9-4940-84c3-401b105ee05c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:21.976053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1004/2003] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:21.981049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:21.987021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:21.993833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727d12-4c24-4085-83f4-267151fd8c8d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:21.997548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:21.998321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:21.998692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:21.999038 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] PATH_INFO: `/v3/projects/7dc855e53e9e4113ae6ac09e204c1a50/users/e0047a22c14e46ee9665255eff130c80/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:22.015460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc855e53e9e4113ae6ac09e204c1a50, user_id=e0047a22c14e46ee9665255eff130c80, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:22.018328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:22.084836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1000/2004] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:21 2022] PUT /identity/v3/projects/7dc855e53e9e4113ae6ac09e204c1a50/users/e0047a22c14e46ee9665255eff130c80/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:22.095582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:22.095868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:22.096161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:22.126295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] MFA Rules not processed for user `e0047a22c14e46ee9665255eff130c80`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:22.127414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:22.201950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1005/2005] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:22.209556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:22.211629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:22.274610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:22.296729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128613-a937-4cab-8b1f-cbecdb5de524 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:22.303179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:22.303809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:22.304132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:22.304394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:22.314249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:22.315878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:22.326208 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1001/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:22.566426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:22.629130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02c4a7-ee7b-479b-8def-315a711a924d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:22.633640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:22.634274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:22.634584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:22.635003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] PATH_INFO: `/v3/users/e0047a22c14e46ee9665255eff130c80` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:22.637296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0047a22c14e46ee9665255eff130c80)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:22.639249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:22.651460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:22.861392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0047a22c14e46ee9665255eff130c80'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:22.917526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:22.918974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:22.931696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0047a22c14e46ee9665255eff130c80'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:22.932745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8861-a39d-46f4-b5e4-da2c2c106d54 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:22.933223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0047a22c14e46ee9665255eff130c80'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:22.934640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0047a22c14e46ee9665255eff130c80'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:22.938008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:22.938680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:22.938961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:22.939232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] PATH_INFO: `/v3/users/039ef5a7c9294b8384831ca929f889f8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:22.940596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] RBAC: Authorizing `identity:delete_user(user_id=039ef5a7c9294b8384831ca929f889f8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:22.942607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:22.944624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-182225d9-32e8-49fa-99f8-8281aa5844f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0047a22c14e46ee9665255eff130c80'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:22.961919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1006/2007] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:22 2022] DELETE /identity/v3/users/e0047a22c14e46ee9665255eff130c80 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:22.966533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:22.966820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:22.967090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:22.986809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:22.988012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:23.004796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:23.052891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1007/2008] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:23.065637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:23.067208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:23.133086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039ef5a7c9294b8384831ca929f889f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.133734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039ef5a7c9294b8384831ca929f889f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.142231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31941-6f30-4575-bd8a-a756693c88d3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:23.145458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c136b9-4547-4adf-954c-bcc1827a2a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:23.146411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c136b9-4547-4adf-954c-bcc1827a2a14 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:23.147864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:23.148333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c136b9-4547-4adf-954c-bcc1827a2a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:23.148662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c136b9-4547-4adf-954c-bcc1827a2a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:23.158027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c136b9-4547-4adf-954c-bcc1827a2a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:23.159904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c136b9-4547-4adf-954c-bcc1827a2a14 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:23.169835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1008/2009] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:23.204150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039ef5a7c9294b8384831ca929f889f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.204817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039ef5a7c9294b8384831ca929f889f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.217165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039ef5a7c9294b8384831ca929f889f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.229263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1002/2010] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:22 2022] DELETE /identity/v3/users/039ef5a7c9294b8384831ca929f889f8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:23.234905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:23.235202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:23.235546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:23.262447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:23.263799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:23.330355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1009/2011] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:23.340095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:23.341657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:23.422291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916e45a-1e3d-4347-9a8e-43507020070b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:23.427212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:23.428022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:23.428392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:23.428737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:23.442844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:23.444780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:23.445441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:23.457016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1003/2012] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:23.703492 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:23.705207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:23.718011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b677c2-3f56-4457-8bdf-4e836072ed8c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:23.723146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:23.723798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:23.724084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:23.724358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] PATH_INFO: `/v3/projects/7dc855e53e9e4113ae6ac09e204c1a50` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:23.725534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc855e53e9e4113ae6ac09e204c1a50)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:23.727495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:23.866894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc855e53e9e4113ae6ac09e204c1a50', 'request_id': 'req-0acf09d7-28c3-4dde-b416-38cd52010788'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.873692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc855e53e9e4113ae6ac09e204c1a50', 'request_id': 'req-0acf09d7-28c3-4dde-b416-38cd52010788'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.875419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:23.942184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc855e53e9e4113ae6ac09e204c1a50', 'request_id': 'req-0acf09d7-28c3-4dde-b416-38cd52010788'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.952243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:23.953798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:23.958077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] The token cache is being invalidate because project 7dc855e53e9e4113ae6ac09e204c1a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:23.958367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.959039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0acf09d7-28c3-4dde-b416-38cd52010788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:23.960547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1010/2013] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:23 2022] DELETE /identity/v3/projects/7dc855e53e9e4113ae6ac09e204c1a50 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:23.969311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fd1e2-abfd-4d02-86db-053ad4bfb97a service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:23.974811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400497ea-bbab-44dc-b876-2591dd19014e None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:23.975105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400497ea-bbab-44dc-b876-2591dd19014e None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:23.975383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400497ea-bbab-44dc-b876-2591dd19014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:23.981206 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:23.995476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-400497ea-bbab-44dc-b876-2591dd19014e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:23.996686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-400497ea-bbab-44dc-b876-2591dd19014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:24.030103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.030773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.031060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.031381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] PATH_INFO: `/v3/projects/b63c77e53d324040af796f074bf373db` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.032526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63c77e53d324040af796f074bf373db)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.034437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.056116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1011/2014] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:24.065249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.065533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.065943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.086431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:24.087805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:24.100667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1012/2015] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:24.106894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.116109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13c4e1-f56e-4495-a105-c9edb509fd97 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.121109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.121709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.121984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.122248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.122929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:24.127922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.127922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.140104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1013/2016] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:24.141556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63c77e53d324040af796f074bf373db', 'request_id': 'req-790bb932-7a1f-40e5-8920-96ba53c2048f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.144376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.149501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63c77e53d324040af796f074bf373db', 'request_id': 'req-790bb932-7a1f-40e5-8920-96ba53c2048f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.155737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372ce6-2958-465c-b1e2-6cd9a74ebeed admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.222415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.223060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.223345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.223621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.224266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.226285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.261498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63c77e53d324040af796f074bf373db', 'request_id': 'req-790bb932-7a1f-40e5-8920-96ba53c2048f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.275231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] The token cache is being invalidate because project b63c77e53d324040af796f074bf373db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:24.275709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.276661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.278170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1004/2017] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:23 2022] DELETE /identity/v3/projects/b63c77e53d324040af796f074bf373db => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:24.282045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.283396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:24.297171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bb932-7a1f-40e5-8920-96ba53c2048f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.301751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.302372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.302695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.302973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] PATH_INFO: `/v3/users/d9ee7b1149f74c3d9cb08bf4d718a89d` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.304100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ee7b1149f74c3d9cb08bf4d718a89d)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.306047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.350591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1014/2018] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:24 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:24.353004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.355118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:24.404029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:24.419399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0915c-a317-41ec-aac0-23d53343dd46 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.424124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.424721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.424996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.425262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.425882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.427812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.520781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ee7b1149f74c3d9cb08bf4d718a89d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.521357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ee7b1149f74c3d9cb08bf4d718a89d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.570812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1015/2019] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:24 2022] POST /identity/v3/users => generated 303 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:24.575620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.586381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d757780-094f-47f1-83c5-5eb21045e834 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.591844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.592448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.592731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.593007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.593658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.595497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.602187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ee7b1149f74c3d9cb08bf4d718a89d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.603210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ee7b1149f74c3d9cb08bf4d718a89d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.625487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ee7b1149f74c3d9cb08bf4d718a89d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:24.642459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1016/2020] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:24.642459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.643349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:24.656224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1005/2021] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:24 2022] DELETE /identity/v3/users/d9ee7b1149f74c3d9cb08bf4d718a89d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:24.657287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.658953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:24.677795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141bd17-c196-4ecc-af9f-b2225551e04a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.685749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:24.752355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080563-3ffb-4d55-9b46-be4f93dcee6f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.758197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.759091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.759640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.759941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.760606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.762349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.779898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1006/2022] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:24.779898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:24.788802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.789514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.790029 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.790361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] PATH_INFO: `/v3/users/078950da201047fe9160335aed152a66` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.793134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078950da201047fe9160335aed152a66)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.794537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7603fe-af4d-4f59-b7f5-2ebd2d1bb051 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:24.794708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.800296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804add2-ddbe-4271-adff-d9a442fedb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:24.800971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804add2-ddbe-4271-adff-d9a442fedb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.801654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804add2-ddbe-4271-adff-d9a442fedb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.801654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804add2-ddbe-4271-adff-d9a442fedb07 admin admin] PATH_INFO: `/v3/projects/931bc6ce7c564bf7b7e3fb40c6c24fa2/users/27159012559b4edc9adb13bba41815a0/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.819722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804add2-ddbe-4271-adff-d9a442fedb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931bc6ce7c564bf7b7e3fb40c6c24fa2, user_id=27159012559b4edc9adb13bba41815a0, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:24.823188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804add2-ddbe-4271-adff-d9a442fedb07 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:24.927813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1007/2023] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:24 2022] PUT /identity/v3/projects/931bc6ce7c564bf7b7e3fb40c6c24fa2/users/27159012559b4edc9adb13bba41815a0/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:24.939045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:24.939325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:24.939599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:24.979970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] MFA Rules not processed for user `27159012559b4edc9adb13bba41815a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:24.981305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:25.030745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078950da201047fe9160335aed152a66'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.059729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1008/2024] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:25.063965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.112933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078950da201047fe9160335aed152a66'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.113574 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078950da201047fe9160335aed152a66'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.114220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078950da201047fe9160335aed152a66'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.123437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-cf1c680a-09d6-4d22-85db-9096ab73f850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078950da201047fe9160335aed152a66'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.126294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b27d8-9ced-4777-88ac-f53874d5c940 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.130895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.131550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.131828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.132096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.132719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.134649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.141763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1017/2025] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:24 2022] DELETE /identity/v3/users/078950da201047fe9160335aed152a66 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:25.146038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.146322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.146629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.167819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:25.169119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:25.220177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:25.227127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1009/2026] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:25 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:25.228172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.233159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:25.243336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1018/2027] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:25.244975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.246425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:25.261403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22808c8-0459-4664-b637-c299dabe2764 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.299449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:25.325227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4cf0b-3191-4aa4-81ec-311e7dd8dd8c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.330304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.330972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.331418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.331713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] PATH_INFO: `/v3/projects/425052d9bec049698b2d3f898e255eac` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.332838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=425052d9bec049698b2d3f898e255eac)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.334877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.336284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.336906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.337289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.337451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.340617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.342195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.450954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1019/2028] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:25 2022] POST /identity/v3/users => generated 307 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:25.455569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.455569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:25.467787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425052d9bec049698b2d3f898e255eac', 'request_id': 'req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.474702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425052d9bec049698b2d3f898e255eac', 'request_id': 'req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.516923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1bf4-3099-44ae-8bbe-37758bea8bcb admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.558867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425052d9bec049698b2d3f898e255eac', 'request_id': 'req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.566535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.568399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.568399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.568399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.572545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] The token cache is being invalidate because project 425052d9bec049698b2d3f898e255eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:25.572853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.573521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.575123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1010/2029] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:25 2022] DELETE /identity/v3/projects/425052d9bec049698b2d3f898e255eac => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:25.575925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.577868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:25.629373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.630843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.641227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1020/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:25.642050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.646916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0f9b-beb7-4edf-80af-9f8c84e07e8b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.652729 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838507ea-e2dc-44ba-8d05-7b3c4000d9af service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.653565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.654691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.655256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.655985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.660062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.660728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.660728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.660728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.660728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] PATH_INFO: `/v3/users/398313e8866d442e9ab4e50ff3f21e14` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.661035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.661109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398313e8866d442e9ab4e50ff3f21e14)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.662418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.673644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1011/2031] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:25.677386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.688813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b8a9-b3aa-4ba3-89e3-21ca49ec5514 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.693789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.694440 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.694753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.695025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] PATH_INFO: `/v3/projects/9b5618c1b2544305a1815032a1aa2816/users/88b2e4b0a6954fcf8a3c170dc116d0cd/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.710955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5618c1b2544305a1815032a1aa2816, user_id=88b2e4b0a6954fcf8a3c170dc116d0cd, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.713959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.832129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1012/2032] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:25 2022] PUT /identity/v3/projects/9b5618c1b2544305a1815032a1aa2816/users/88b2e4b0a6954fcf8a3c170dc116d0cd/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:25.836073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.846878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:25.930329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:25.930911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2ce2-4f72-4585-a3f2-07f056e94f9b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.936056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.936707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.937229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.937229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.939587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.940199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.952212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1013/2033] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:25.961073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:25.971418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57e10-5817-4c50-bf18-a59f48fd0e56 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:25.974778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398313e8866d442e9ab4e50ff3f21e14'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:25.980310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b2250-dc9e-4521-8d74-d49a8811bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:25.980987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b2250-dc9e-4521-8d74-d49a8811bb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:25.981269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b2250-dc9e-4521-8d74-d49a8811bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:25.981550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b2250-dc9e-4521-8d74-d49a8811bb77 admin admin] PATH_INFO: `/v3/projects/9b5618c1b2544305a1815032a1aa2816/users/88b2e4b0a6954fcf8a3c170dc116d0cd/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:25.983538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b2250-dc9e-4521-8d74-d49a8811bb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5618c1b2544305a1815032a1aa2816, user_id=88b2e4b0a6954fcf8a3c170dc116d0cd, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:25.986316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b2250-dc9e-4521-8d74-d49a8811bb77 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:25.997850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1014/2034] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:25 2022] PUT /identity/v3/projects/9b5618c1b2544305a1815032a1aa2816/users/88b2e4b0a6954fcf8a3c170dc116d0cd/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:26.008374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.008727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.009011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.038079 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] MFA Rules not processed for user `88b2e4b0a6954fcf8a3c170dc116d0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:26.039339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.050350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398313e8866d442e9ab4e50ff3f21e14'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.051014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398313e8866d442e9ab4e50ff3f21e14'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.051635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398313e8866d442e9ab4e50ff3f21e14'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.059190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398313e8866d442e9ab4e50ff3f21e14'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.077688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1021/2035] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:25 2022] DELETE /identity/v3/users/398313e8866d442e9ab4e50ff3f21e14 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:26.118765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1015/2036] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:26.130635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:26.131274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.131609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:26.133013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.206992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6373d3a-6020-4215-a81a-8710535def53 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:26.212408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:26.213130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.213418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.213860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.214148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685c06e-49f0-4263-858b-3b95823d8432 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:26.278419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:26.278952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:26.279616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.279888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.279985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:26.280155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] PATH_INFO: `/v3/projects/8272bda972734f81b0d73140f55813b6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.281269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8272bda972734f81b0d73140f55813b6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:26.283273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:26.292314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1022/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:26.371272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:26.430631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8272bda972734f81b0d73140f55813b6', 'request_id': 'req-3c5accec-c0e3-469b-982f-9e49af1785f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.440495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8272bda972734f81b0d73140f55813b6', 'request_id': 'req-3c5accec-c0e3-469b-982f-9e49af1785f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.441483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:26.443588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.455072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:26.459948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a015bf-d96a-4a25-bb3f-e7322bd882ad service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:26.518386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8272bda972734f81b0d73140f55813b6', 'request_id': 'req-3c5accec-c0e3-469b-982f-9e49af1785f8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.520737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:26.521564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.522040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.522314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] PATH_INFO: `/v3/users/27159012559b4edc9adb13bba41815a0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.523883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] RBAC: Authorizing `identity:delete_user(user_id=27159012559b4edc9adb13bba41815a0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:26.527336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:26.535577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] The token cache is being invalidate because project 8272bda972734f81b0d73140f55813b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:26.535877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.536863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.551972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1016/2038] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:26 2022] DELETE /identity/v3/projects/8272bda972734f81b0d73140f55813b6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:26.552386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:26.557933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.590088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5accec-c0e3-469b-982f-9e49af1785f8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:26.590725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:26.591928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.592279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.592670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] PATH_INFO: `/v3/projects/714f2e96557c4b9ebd4f3ac4559f2878` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.594133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714f2e96557c4b9ebd4f3ac4559f2878)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:26.596313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:26.735347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27159012559b4edc9adb13bba41815a0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.777042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714f2e96557c4b9ebd4f3ac4559f2878', 'request_id': 'req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.783601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714f2e96557c4b9ebd4f3ac4559f2878', 'request_id': 'req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.844386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27159012559b4edc9adb13bba41815a0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.844925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27159012559b4edc9adb13bba41815a0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.845542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27159012559b4edc9adb13bba41815a0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.853712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-703bc138-c9c3-4e24-ab6b-896e2e2052da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27159012559b4edc9adb13bba41815a0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.872175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1023/2039] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:26 2022] DELETE /identity/v3/users/27159012559b4edc9adb13bba41815a0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:26.876487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.876772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.877047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.896648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:26.897852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.907400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714f2e96557c4b9ebd4f3ac4559f2878', 'request_id': 'req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.923891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] The token cache is being invalidate because project 714f2e96557c4b9ebd4f3ac4559f2878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:26.924450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.925189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8bcfdcaf-8ae1-407a-a689-91eb02dd96a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:26.932659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1017/2040] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:26 2022] DELETE /identity/v3/projects/714f2e96557c4b9ebd4f3ac4559f2878 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:26.934047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e92d5-3307-4979-b537-1e5644de67af None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.934339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e92d5-3307-4979-b537-1e5644de67af None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.934644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e92d5-3307-4979-b537-1e5644de67af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.956185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6b8e92d5-3307-4979-b537-1e5644de67af None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:26.957422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6b8e92d5-3307-4979-b537-1e5644de67af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.959581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1024/2041] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:26.966296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1018/2042] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:26.969895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:26.971468 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:26.973909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:26.974916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:26.975304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:26.998991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:27.001146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:27.011937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1019/2043] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:27.019520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.030884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a9a8-ab5d-4668-86a6-6029a60e845b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.038828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.039729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.040219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.040639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.042025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:27.042641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.045746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.055561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5576b4b-d61b-419f-9140-942d4d70ce29 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.060481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1020/2044] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:27.061731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.063374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.063928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.064718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.064988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.068665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:27.077716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2a4b-9ec0-4e64-a947-08b0dcc866d1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.083184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.083795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.084071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.085368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.086041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.089003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.090601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.095369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:27.098113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.112176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1025/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:27.194972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1021/2046] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:27 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:27.200036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.211020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a58e-0945-4632-a20e-0b9070f262c6 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.273541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.274148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.274425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.274736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.275961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.277916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.359712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1026/2047] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:27 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:27.360882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.374885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed53a9c-e9f4-4eac-8e94-b6fd39d9c35e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.381760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.382411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.382722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.382992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.383630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.385916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.399929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1022/2048] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:27.402062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.412683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828bd1-63a0-4af1-88fc-bdc22941e95b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.418040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43423b28-fb2f-4eea-833c-7b21e3293231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.418677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43423b28-fb2f-4eea-833c-7b21e3293231 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.418992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43423b28-fb2f-4eea-833c-7b21e3293231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.419266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43423b28-fb2f-4eea-833c-7b21e3293231 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.419917 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43423b28-fb2f-4eea-833c-7b21e3293231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.421507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43423b28-fb2f-4eea-833c-7b21e3293231 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.432604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1027/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:27.436862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.448449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d46e97-a342-49e3-97b5-b09b4f3e78b9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.452595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.453245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.453552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.453819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] PATH_INFO: `/v3/projects/38d1361415444603b6ec30f67ea98aa7/users/4f8130d23868424f9ee600cd8753b687/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.471051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d1361415444603b6ec30f67ea98aa7, user_id=4f8130d23868424f9ee600cd8753b687, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.473807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.570447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1023/2050] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:27 2022] PUT /identity/v3/projects/38d1361415444603b6ec30f67ea98aa7/users/4f8130d23868424f9ee600cd8753b687/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:27.576520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.576807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.577080 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.598206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:27.599554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:27.606957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.611227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:27.668561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1028/2051] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:27.678418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.680331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:27.683774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0161b3-adfd-4135-8198-53adbdf60321 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.688631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.689249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.689524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.689794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] PATH_INFO: `/v3/projects/931bc6ce7c564bf7b7e3fb40c6c24fa2` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.691140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=931bc6ce7c564bf7b7e3fb40c6c24fa2)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.693480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.734667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:27.741439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745a6f1-babc-4e35-9f4f-9978d6fd21ca None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:27.748059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:27.749127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:27.749482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:27.749759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:27.758982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:27.761421 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:27.770896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1029/2052] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:27.840427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931bc6ce7c564bf7b7e3fb40c6c24fa2', 'request_id': 'req-65709451-8780-405c-a495-fa8550de4bbd'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:27.846704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931bc6ce7c564bf7b7e3fb40c6c24fa2', 'request_id': 'req-65709451-8780-405c-a495-fa8550de4bbd'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:27.918948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931bc6ce7c564bf7b7e3fb40c6c24fa2', 'request_id': 'req-65709451-8780-405c-a495-fa8550de4bbd'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:27.931135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] The token cache is being invalidate because project 931bc6ce7c564bf7b7e3fb40c6c24fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:27.931452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:27.932653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:27.934249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1024/2053] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:27 2022] DELETE /identity/v3/projects/931bc6ce7c564bf7b7e3fb40c6c24fa2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:27.938223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:27.949307 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5ca32-241b-4b1d-ba40-7a6cb706d926 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:28.006244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:28.006891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:28.007178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:28.007450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] PATH_INFO: `/v3/users/88b2e4b0a6954fcf8a3c170dc116d0cd` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:28.008577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b2e4b0a6954fcf8a3c170dc116d0cd)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:28.015353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:28.231881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b2e4b0a6954fcf8a3c170dc116d0cd'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:28.296117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b2e4b0a6954fcf8a3c170dc116d0cd'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:28.296764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b2e4b0a6954fcf8a3c170dc116d0cd'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:28.297366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b2e4b0a6954fcf8a3c170dc116d0cd'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:28.305560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-18d32540-51dc-4b37-9c55-d3a6754058e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b2e4b0a6954fcf8a3c170dc116d0cd'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:28.336096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1030/2054] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:27 2022] DELETE /identity/v3/users/88b2e4b0a6954fcf8a3c170dc116d0cd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:28.987730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:28.989243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:29.004318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65709451-8780-405c-a495-fa8550de4bbd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.058003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:29.076536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.077252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.077546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.077821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] PATH_INFO: `/v3/projects/9b5618c1b2544305a1815032a1aa2816` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.079014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5618c1b2544305a1815032a1aa2816)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.080955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.227740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5618c1b2544305a1815032a1aa2816', 'request_id': 'req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:29.234717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5618c1b2544305a1815032a1aa2816', 'request_id': 'req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:29.353115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5618c1b2544305a1815032a1aa2816', 'request_id': 'req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:29.367139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.367658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.367989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.376995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] The token cache is being invalidate because project 9b5618c1b2544305a1815032a1aa2816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:29.377285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:29.377994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-406d10d1-caf0-4bf3-a13d-107c6e2b09e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:29.382961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1025/2055] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:28 2022] DELETE /identity/v3/projects/9b5618c1b2544305a1815032a1aa2816 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:29.384645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6762a-ef9a-4861-820e-56c278da5eff None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.385329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6762a-ef9a-4861-820e-56c278da5eff None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.385596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6762a-ef9a-4861-820e-56c278da5eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.400244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] MFA Rules not processed for user `4f8130d23868424f9ee600cd8753b687`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:29.402311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:29.408044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-64d6762a-ef9a-4861-820e-56c278da5eff None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:29.409284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-64d6762a-ef9a-4861-820e-56c278da5eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:29.475016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:29.480815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1031/2056] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:29.491730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.493076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:29.503076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1026/2057] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:29.512551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.513010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.513131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.534282 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:29.535811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:29.545106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1027/2058] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:29.549248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.559910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de21d-4e90-4f00-8c8f-c7eabc4168a2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.565119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.565730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.566023 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.566286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.567027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:29.567337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.569122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.572504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f703-3a51-4a2a-a931-5dca441d1c22 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.577659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.578627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.578995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.579333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.585933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1028/2059] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:29.586769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.594551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.596622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.598087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7d46-a7fd-4b5b-a9ec-fe66dbe4df84 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.605517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.606223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.606401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.606701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.607908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.608309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1032/2060] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:29.615888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.693195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1029/2061] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:29 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:29.697584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.709365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2b037-8b40-4f0d-9033-96d39157df63 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.783878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.784487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.785021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.785296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.785927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.787964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.868120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1033/2062] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:29 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:29.874112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.884878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7bc1-b7e3-428f-b375-b2f65014bb57 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.892945 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.893544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.893821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.894090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.894900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.901242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.907767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1030/2063] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:29.912992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.925708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf99a0-ebc9-4204-831f-d8e334a3742b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.930589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.931180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.931459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.931730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.932395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.934929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:29.944765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1034/2064] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:29.949213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:29.960728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5790a-e066-4354-893c-787668d22162 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:29.966171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d28f3-0bc2-4a48-a1d3-0dcfa2f08f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:29.966863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d28f3-0bc2-4a48-a1d3-0dcfa2f08f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:29.967145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d28f3-0bc2-4a48-a1d3-0dcfa2f08f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:29.967421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d28f3-0bc2-4a48-a1d3-0dcfa2f08f4b admin admin] PATH_INFO: `/v3/projects/b38a0098c459401cb177513a90ce34ed/users/2bff44a40cdf4565b9344b116095a8e8/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:29.984498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d28f3-0bc2-4a48-a1d3-0dcfa2f08f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38a0098c459401cb177513a90ce34ed, user_id=2bff44a40cdf4565b9344b116095a8e8, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:29.987245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d28f3-0bc2-4a48-a1d3-0dcfa2f08f4b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.018482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.020254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:30.033364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5359e-92c4-4dff-8b25-fc400613714d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.038149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.038816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.039094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.041757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] PATH_INFO: `/v3/users/2764739e0cde45729ae9835dbaaf1d48` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.041757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2764739e0cde45729ae9835dbaaf1d48)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.043627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.084629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:30.087301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1031/2065] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:29 2022] PUT /identity/v3/projects/b38a0098c459401cb177513a90ce34ed/users/2bff44a40cdf4565b9344b116095a8e8/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:30.098073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.098357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.098660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.126256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] MFA Rules not processed for user `2bff44a40cdf4565b9344b116095a8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:30.127487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:30.191644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1032/2066] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:30.196086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.261753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b6fa1-54bb-420c-bcc3-40c97c7ae264 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.263911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2764739e0cde45729ae9835dbaaf1d48'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:30.266727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.267390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.267669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.267942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.268590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.270560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.370758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2764739e0cde45729ae9835dbaaf1d48'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:30.371463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2764739e0cde45729ae9835dbaaf1d48'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:30.371976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2764739e0cde45729ae9835dbaaf1d48'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:30.380429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-335fcd01-e90a-4c77-9bd1-87e06b503c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2764739e0cde45729ae9835dbaaf1d48'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:30.403746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1035/2067] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:30 2022] DELETE /identity/v3/users/2764739e0cde45729ae9835dbaaf1d48 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:30.407473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1033/2068] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:30 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:30.408647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.408940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.409207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.411541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.413148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:30.430480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:30.433170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:30.480532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153513-4fb2-4d42-b344-6a9dd39c5baa admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.486377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.487013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.487291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.487561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.488189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.490110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.499137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1036/2069] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:30.508977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.510548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:30.571598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e946-e1f9-4bb6-814a-12b471a33143 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.576883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.577479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.577758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.578028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.582809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1034/2070] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:30 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:30.586709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.587407 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.588908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.596577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d36771-0795-4ce4-8142-f8c967e35879 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.598459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1037/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:30.602319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.602694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.602694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.603019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.603734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.605330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.615991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1035/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:30.621863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.631898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507791-00fb-4a61-a535-5fe03b7e25c2 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.637629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.643430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.643430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.643682 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] PATH_INFO: `/v3/projects/27a9e09138834fe4837ebada43aca3fa/users/d14f457f56c0493880723c3e77c8cf3b/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.662920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9e09138834fe4837ebada43aca3fa, user_id=d14f457f56c0493880723c3e77c8cf3b, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.665799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.678330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:30.748370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1038/2073] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:30 2022] PUT /identity/v3/projects/27a9e09138834fe4837ebada43aca3fa/users/d14f457f56c0493880723c3e77c8cf3b/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:30.752413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.765768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aefe0e-301c-4a7b-966f-56f9a4f9d57f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.827150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce031f2c-09a4-4f0c-847f-fe6882e01110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.827768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce031f2c-09a4-4f0c-847f-fe6882e01110 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.828049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce031f2c-09a4-4f0c-847f-fe6882e01110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.828324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce031f2c-09a4-4f0c-847f-fe6882e01110 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.828976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce031f2c-09a4-4f0c-847f-fe6882e01110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.830758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce031f2c-09a4-4f0c-847f-fe6882e01110 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.840873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1036/2074] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:30.845043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:30.855560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106afde-0409-4e69-9001-7a95003930c3 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:30.860260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:30.860909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.861193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.861465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] PATH_INFO: `/v3/projects/27a9e09138834fe4837ebada43aca3fa/users/d14f457f56c0493880723c3e77c8cf3b/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.863434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9e09138834fe4837ebada43aca3fa, user_id=d14f457f56c0493880723c3e77c8cf3b, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:30.866056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:30.876889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1039/2075] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:30 2022] PUT /identity/v3/projects/27a9e09138834fe4837ebada43aca3fa/users/d14f457f56c0493880723c3e77c8cf3b/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:30.887776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:30.888058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:30.888328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:30.917197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] MFA Rules not processed for user `d14f457f56c0493880723c3e77c8cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:30.918403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:30.997718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1037/2076] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:31.014067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:31.014067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:31.071215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f1131-86cb-4c97-8a73-10f74c5b353c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:31.074860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551cc09-6904-43f0-84ea-2f202b6d2662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:31.075493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551cc09-6904-43f0-84ea-2f202b6d2662 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:31.075767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551cc09-6904-43f0-84ea-2f202b6d2662 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:31.076032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551cc09-6904-43f0-84ea-2f202b6d2662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:31.085383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551cc09-6904-43f0-84ea-2f202b6d2662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:31.086851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551cc09-6904-43f0-84ea-2f202b6d2662 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:31.097383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1040/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:31.147650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:31.154893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:31.222878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:31.228166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9828e-d8e0-4dc9-b544-4ea3de66a1bf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:31.233541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:31.234153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:31.234743 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:31.235014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] PATH_INFO: `/v3/projects/e424c8a734c946bca01c577fc4c63a9a` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:31.236155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e424c8a734c946bca01c577fc4c63a9a)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:31.238048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:31.366434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e424c8a734c946bca01c577fc4c63a9a', 'request_id': 'req-0d4ed213-d878-46e6-ab12-e3281a8575c4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.373852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e424c8a734c946bca01c577fc4c63a9a', 'request_id': 'req-0d4ed213-d878-46e6-ab12-e3281a8575c4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.398861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:31.429189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:31.429472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:31.429740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:31.449260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] MFA Rules not processed for user `4f8130d23868424f9ee600cd8753b687`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:31.450445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:31.472780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e424c8a734c946bca01c577fc4c63a9a', 'request_id': 'req-0d4ed213-d878-46e6-ab12-e3281a8575c4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.484463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] The token cache is being invalidate because project e424c8a734c946bca01c577fc4c63a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:31.484750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.485414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.486957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1038/2078] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:31 2022] DELETE /identity/v3/projects/e424c8a734c946bca01c577fc4c63a9a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:31.490223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:31.491813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:31.493447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:31.506952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1041/2079] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:31.562311 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ed213-d878-46e6-ab12-e3281a8575c4 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:31.567018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:31.567647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:31.567926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:31.568201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] PATH_INFO: `/v3/users/74704cf0753c48859db145aa609cc1a7` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:31.569415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74704cf0753c48859db145aa609cc1a7)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:31.574970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:31.820087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74704cf0753c48859db145aa609cc1a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.820745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74704cf0753c48859db145aa609cc1a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.934833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74704cf0753c48859db145aa609cc1a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.935592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74704cf0753c48859db145aa609cc1a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.959277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74704cf0753c48859db145aa609cc1a7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:31.970224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1039/2080] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:31 2022] DELETE /identity/v3/users/74704cf0753c48859db145aa609cc1a7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:32.308054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:32.310206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:32.392578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f1a4f-f4b1-42ce-930a-108ce5c3f681 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:32.467760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14f457f56c0493880723c3e77c8cf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27a9e09138834fe4837ebada43aca3fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:32.470663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:32.470663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:32.470663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:32.470663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:32.470663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:32.471525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:32.486258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1042/2081] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:32.487328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:32.488859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:32.502263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa062-5d3f-4437-ba98-7b34d7b2faf9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:32.507037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14f457f56c0493880723c3e77c8cf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27a9e09138834fe4837ebada43aca3fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:32.507659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:32.507943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:32.508216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:32.508870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:32.511531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:32.529910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:32.612466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:32.614393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:32.643875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1040/2082] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:32 2022] POST /identity/v3/projects => generated 354 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:32.646496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:32.668784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:32.687241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c174b-0cbd-44cc-b9a4-1b1961c3e0bc tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:32.712091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62632d-d78f-46dc-ab2f-107d1044949e tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:32.716879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14f457f56c0493880723c3e77c8cf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27a9e09138834fe4837ebada43aca3fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:32.717491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:32.717772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:32.718049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:32.718727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:32.719033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:32.720748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:32.736136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1041/2083] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:32.750035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:32.751631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:32.751915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:32.752184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] PATH_INFO: `/v3/projects/27cc80789fbf4077938358f3964f9f22` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:32.758333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cc80789fbf4077938358f3964f9f22)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:32.758333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:32.774140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:32.784697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640db6d-54db-48f0-81a5-709371a08932 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:32.789477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd14f457f56c0493880723c3e77c8cf3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27a9e09138834fe4837ebada43aca3fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:32.790087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:32.790372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:32.790674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] PATH_INFO: `/v3/projects/16982a993a3c442d84d2d122797c0c11` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:32.792386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16982a993a3c442d84d2d122797c0c11)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:32.794284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:32.879402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cc80789fbf4077938358f3964f9f22', 'request_id': 'req-8f1fda4a-5872-4a71-896a-8df1b115881b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.885582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cc80789fbf4077938358f3964f9f22', 'request_id': 'req-8f1fda4a-5872-4a71-896a-8df1b115881b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.902236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16982a993a3c442d84d2d122797c0c11', 'request_id': 'req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.908760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16982a993a3c442d84d2d122797c0c11', 'request_id': 'req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.953424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cc80789fbf4077938358f3964f9f22', 'request_id': 'req-8f1fda4a-5872-4a71-896a-8df1b115881b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.965284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] The token cache is being invalidate because project 27cc80789fbf4077938358f3964f9f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:32.965575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.966231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f1fda4a-5872-4a71-896a-8df1b115881b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:32.967941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1043/2084] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:32 2022] DELETE /identity/v3/projects/27cc80789fbf4077938358f3964f9f22 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:32.972593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff816d9-6d9f-4f23-8137-ef1a7a56ce49 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:32.972876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff816d9-6d9f-4f23-8137-ef1a7a56ce49 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:32.973149 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff816d9-6d9f-4f23-8137-ef1a7a56ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:32.992788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-dff816d9-6d9f-4f23-8137-ef1a7a56ce49 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:32.993906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dff816d9-6d9f-4f23-8137-ef1a7a56ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:33.053745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1044/2085] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:33.062622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.062912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.063177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.066271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16982a993a3c442d84d2d122797c0c11', 'request_id': 'req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:33.086149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] The token cache is being invalidate because project 16982a993a3c442d84d2d122797c0c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:33.086736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:33.087414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:33.088700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:33.090232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:33.094321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1042/2086] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:32 2022] DELETE /identity/v3/projects/16982a993a3c442d84d2d122797c0c11 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:33.104576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1045/2087] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:33.106204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.118729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d90d6-8f30-45e4-ac07-5d3312a764c4 tempest-VolumeQuotaClassesTest-1840359104 tempest-VolumeQuotaClassesTest-1840359104-project-admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.124006 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.124367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.124608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.124902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.125539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:33.125838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.127831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.142536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1043/2088] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:33.145676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.158981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160c3cb-196f-4da6-b95a-44bc3958c9eb None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.164267 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.164876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.165156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.165433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.166134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.168061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.185027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:33.247175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1046/2089] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:33 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:33.251419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.263142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d738857-df80-4aa3-bbeb-10d23e8e833c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.320168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.320766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.321046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.321320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.321949 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.326733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.444985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1044/2090] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:33 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:33.449554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.459793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0ec53-b436-4829-aa41-e80ab5a280c8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.465271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.466060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.466332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.466720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.467491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.471088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.488564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1047/2091] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:33.489827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.511230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a5f0c-e5bc-4039-9bc3-4d0677f2c50b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.511230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3969fe-d6c5-4cdd-8d53-9bbdb512c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.511230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3969fe-d6c5-4cdd-8d53-9bbdb512c4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.511230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3969fe-d6c5-4cdd-8d53-9bbdb512c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.511652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3969fe-d6c5-4cdd-8d53-9bbdb512c4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.511652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3969fe-d6c5-4cdd-8d53-9bbdb512c4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.511652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3969fe-d6c5-4cdd-8d53-9bbdb512c4e0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.520284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1045/2092] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:33.524642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.530218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:33.535958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b839d1-85ea-4a9e-beb9-2e66d4420fa1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.540693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.541399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.545784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.545784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] PATH_INFO: `/v3/projects/b174270dbeea4c4bbe90bfbf3c09405f/users/fa7bf0b3e2da4289884170998b46eda0/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.556394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b174270dbeea4c4bbe90bfbf3c09405f, user_id=fa7bf0b3e2da4289884170998b46eda0, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.559699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.657084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1048/2093] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:33 2022] PUT /identity/v3/projects/b174270dbeea4c4bbe90bfbf3c09405f/users/fa7bf0b3e2da4289884170998b46eda0/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:33.668356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.668640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.668912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.698266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] MFA Rules not processed for user `fa7bf0b3e2da4289884170998b46eda0`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:33.699610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:33.765397 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1046/2094] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:33.769832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.796831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:33.798227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:33.843479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ecbba-2ebe-41b2-9eb0-38a4784e5943 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.849693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.850441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.850821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.851167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.851872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.854229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.866852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356010e-e621-4a83-91cd-5c8df1ed4ec3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:33.872089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:33.872715 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:33.874047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:33.874047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] PATH_INFO: `/v3/users/2bff44a40cdf4565b9344b116095a8e8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:33.874589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bff44a40cdf4565b9344b116095a8e8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:33.876502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:33.953954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1049/2095] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:33 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:33.954980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.017880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a85fa-3aa5-4391-8657-74be4eb55ba6 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.023130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.024353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.024631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.024907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.026031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.027864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.070923 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bff44a40cdf4565b9344b116095a8e8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:34.071795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bff44a40cdf4565b9344b116095a8e8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:34.108177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1050/2096] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:33 2022] POST /identity/v3/users => generated 303 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:34.112161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.123480 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd155875-d837-446b-af0a-f31ba6028851 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.128284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.130195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.130195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.130195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.130195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.131607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.142629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1051/2097] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:34.146818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.153124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bff44a40cdf4565b9344b116095a8e8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:34.154370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bff44a40cdf4565b9344b116095a8e8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:34.157089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc735b13-84e8-4765-87f5-54ebfb612290 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.162743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.163672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.163959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.164237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] PATH_INFO: `/v3/projects/3a8382b173d644f39fc2cff9da92258e/users/5d548d34281e488a8746a7ec65925180/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.167915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:34.171878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3995c938-281d-466e-a8c3-3516e28b8ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bff44a40cdf4565b9344b116095a8e8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:34.181145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8382b173d644f39fc2cff9da92258e, user_id=5d548d34281e488a8746a7ec65925180, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.184692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.192407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1047/2098] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:33 2022] DELETE /identity/v3/users/2bff44a40cdf4565b9344b116095a8e8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:34.196906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.197867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.198296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.220068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:34.221479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:34.234768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:34.239616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1052/2099] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:34 2022] PUT /identity/v3/projects/3a8382b173d644f39fc2cff9da92258e/users/5d548d34281e488a8746a7ec65925180/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:34.243703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.245994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:34.283464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1048/2100] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:34.295165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.304187 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:34.342660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722130f-e780-4274-af2d-d7f587735685 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.349116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.349732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.350013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.350287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.351035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.352786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.375925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c4e93-064e-451d-9ede-dff13e5771bf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.378413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1053/2101] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:34.380503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.393560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a354bca-900f-4c5a-b1e3-52c98a440785 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.398361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae05f73-d3d7-4989-8d86-a64b12a69d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.399148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05f73-d3d7-4989-8d86-a64b12a69d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.403318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05f73-d3d7-4989-8d86-a64b12a69d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.403318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05f73-d3d7-4989-8d86-a64b12a69d52 admin admin] PATH_INFO: `/v3/projects/3a8382b173d644f39fc2cff9da92258e/users/5d548d34281e488a8746a7ec65925180/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.403318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae05f73-d3d7-4989-8d86-a64b12a69d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8382b173d644f39fc2cff9da92258e, user_id=5d548d34281e488a8746a7ec65925180, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.404784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae05f73-d3d7-4989-8d86-a64b12a69d52 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.418535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1054/2102] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:34 2022] PUT /identity/v3/projects/3a8382b173d644f39fc2cff9da92258e/users/5d548d34281e488a8746a7ec65925180/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:34.429007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.429419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.429906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.465733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] MFA Rules not processed for user `5d548d34281e488a8746a7ec65925180`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:34.466507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.467239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.467627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.467817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:34.468929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.487029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.488778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.514053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1049/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:34.599854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1055/2104] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:34.611472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.612901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:34.669484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:34.676743 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f29f6-d8fe-4639-8063-d3b9fc92a331 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.725452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.726089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.726359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.726658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.736474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.737892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.748624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1050/2105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:34.801522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:34.809369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a674e-59dd-4cc7-9e27-fce6badda6bc None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:34.813230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:34.813839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:34.814119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:34.814395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:34.816209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:34.880826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:34.882459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:34.892623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1056/2106] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:35.200718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:35.202143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:35.293003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf852d-446c-45f2-bb63-9024a82b533a service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:35.297985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:35.298775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:35.299112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:35.302188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] PATH_INFO: `/v3/projects/b38a0098c459401cb177513a90ce34ed` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:35.302188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38a0098c459401cb177513a90ce34ed)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:35.302662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:35.450523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38a0098c459401cb177513a90ce34ed', 'request_id': 'req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.457840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38a0098c459401cb177513a90ce34ed', 'request_id': 'req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.535336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38a0098c459401cb177513a90ce34ed', 'request_id': 'req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.550529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] The token cache is being invalidate because project b38a0098c459401cb177513a90ce34ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:35.550931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.551683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.553432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1051/2107] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:35 2022] DELETE /identity/v3/projects/b38a0098c459401cb177513a90ce34ed => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:35.558668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:35.570221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee2df-8df0-4f91-a322-e4b39f7072cc service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:35.579598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:35.635650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:35.636278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:35.636638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:35.637097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] PATH_INFO: `/v3/users/d14f457f56c0493880723c3e77c8cf3b` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:35.638747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14f457f56c0493880723c3e77c8cf3b)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:35.642371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:35.824635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14f457f56c0493880723c3e77c8cf3b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.907188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14f457f56c0493880723c3e77c8cf3b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.907824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14f457f56c0493880723c3e77c8cf3b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.908489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14f457f56c0493880723c3e77c8cf3b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.917543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-184cab1a-6d65-40f0-84bf-d3a797353bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14f457f56c0493880723c3e77c8cf3b'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:35.937542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1057/2108] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:35 2022] DELETE /identity/v3/users/d14f457f56c0493880723c3e77c8cf3b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:36.591952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:36.593956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:36.633658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b2f4-3b5e-4d1e-841a-aefed350a8cf admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:36.670759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:36.695726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:36.696367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:36.696646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:36.696919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] PATH_INFO: `/v3/projects/27a9e09138834fe4837ebada43aca3fa` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:36.698960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a9e09138834fe4837ebada43aca3fa)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:36.701000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:36.819298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a9e09138834fe4837ebada43aca3fa', 'request_id': 'req-2209c6fa-1da0-4eb9-9812-0cc8be210359'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:36.827308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a9e09138834fe4837ebada43aca3fa', 'request_id': 'req-2209c6fa-1da0-4eb9-9812-0cc8be210359'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:36.912772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a9e09138834fe4837ebada43aca3fa', 'request_id': 'req-2209c6fa-1da0-4eb9-9812-0cc8be210359'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:36.928595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] The token cache is being invalidate because project 27a9e09138834fe4837ebada43aca3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:36.929002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:36.929790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2209c6fa-1da0-4eb9-9812-0cc8be210359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:36.935436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1052/2109] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:36 2022] DELETE /identity/v3/projects/27a9e09138834fe4837ebada43aca3fa => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:36.937199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:36.937656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:36.939054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:36.984166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:36.985486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:37.068916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1058/2110] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:37.077985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.078274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.078592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.121838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:37.122741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:37.132983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1053/2111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:37.138674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.166485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b643989-f0a4-46d3-8f4d-5c251f597ce4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.177479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.178121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.178390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.178684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.179343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:37.179645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.181232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.212159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1059/2112] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:37.217178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.226563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c8478-6d2c-4721-94e0-67c003fe7bb9 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.232058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.232676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.232958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.233234 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.233952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.236007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.349770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1054/2113] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:37 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:37.350595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.362321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4323-1ad9-4b3d-91dd-1d996f0d548d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.378647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:37.469061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.470701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.471790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.472213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.473298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.477190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.569353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.575504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1060/2114] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:37 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:37.580909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124962c7-0bff-41c1-ba25-2cf65d356cf5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.586237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.587069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.601395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.601395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.601395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.601395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.608706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.609096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1055/2115] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:37.620772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cd15-7ad5-43f1-8fea-6273894b73f1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.629014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae2028-c6a2-4080-ace0-dfe35b0ca8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.629775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2028-c6a2-4080-ace0-dfe35b0ca8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.630130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2028-c6a2-4080-ace0-dfe35b0ca8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.630581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae2028-c6a2-4080-ace0-dfe35b0ca8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.631849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae2028-c6a2-4080-ace0-dfe35b0ca8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.633138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae2028-c6a2-4080-ace0-dfe35b0ca8f9 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.646553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1061/2116] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:37.651003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.662682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1881b7-da1e-407f-b654-2a874775c868 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.668976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.669857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.670139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.670408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] PATH_INFO: `/v3/projects/67746069954443cabfb7f45cc71d13c4/users/01d3002ec3a740abb88ee75681df650f/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.686996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67746069954443cabfb7f45cc71d13c4, user_id=01d3002ec3a740abb88ee75681df650f, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.689918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.783678 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1056/2117] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:37 2022] PUT /identity/v3/projects/67746069954443cabfb7f45cc71d13c4/users/01d3002ec3a740abb88ee75681df650f/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:37.795472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.795778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.796033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.825485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] MFA Rules not processed for user `01d3002ec3a740abb88ee75681df650f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:37.826743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:37.905204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1062/2118] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:37.909687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:37.976319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760eb71-6368-4ddb-b5e1-eb3f4f8c20c1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:37.981502 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:37.982224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:37.982542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:37.982821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:37.983467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:37.985373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:37.991308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:38.091453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1057/2119] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:37 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:38.092835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.107435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598894e9-960b-4dbc-a11a-1daf9b02f4f3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.190871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.191816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.191816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.192082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.194758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.195018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.280164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1063/2120] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:38 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:38.284246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.295475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246fc31-dc91-4448-b373-999cd7e0ca36 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.300105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.300694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.300970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.301243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.302027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.303747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.317814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1058/2121] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:38.322674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.329975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b15d4-0785-492c-bbd8-5db6ce4683ff admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.334765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7482c3-1d1a-44b5-8e7b-fde5b24f21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.335408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7482c3-1d1a-44b5-8e7b-fde5b24f21ca admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.335728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7482c3-1d1a-44b5-8e7b-fde5b24f21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.336001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7482c3-1d1a-44b5-8e7b-fde5b24f21ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.336654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7482c3-1d1a-44b5-8e7b-fde5b24f21ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.338842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7482c3-1d1a-44b5-8e7b-fde5b24f21ca admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.344743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:38.353188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1064/2122] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:38.354992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.365093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5bacd-ae4e-4ff0-aab6-dd8b1d26814d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.371475 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.372217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.372564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.372905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] PATH_INFO: `/v3/projects/7de34d0952c24da4ae6fe38f6a978e46/users/6345258060b541ca8f9d07c9e2aa6bd7/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.390389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de34d0952c24da4ae6fe38f6a978e46, user_id=6345258060b541ca8f9d07c9e2aa6bd7, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.393177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.467399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1059/2123] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:38 2022] PUT /identity/v3/projects/7de34d0952c24da4ae6fe38f6a978e46/users/6345258060b541ca8f9d07c9e2aa6bd7/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:38.479240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.479598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.479959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.511325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] MFA Rules not processed for user `6345258060b541ca8f9d07c9e2aa6bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:38.512948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:38.579760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1065/2124] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:38.584227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.645349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df7cc-618b-48c0-8ff9-c94e3657d278 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.653163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.653793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.654121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.654352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.655469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.656982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.765921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1060/2125] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:38 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:38.770736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.781871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d823-e5cd-4003-b8d9-e1b3ccbef1c7 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.839143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.839683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.839961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.840231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.840865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.842840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.907000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1066/2126] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:38 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:38.911224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.922062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae638f4-3cc7-480b-9811-1502f4953eb9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.927020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.927614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.927890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.928190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.928787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.930365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:38.941396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1061/2127] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:38.945698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:38.956832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f471-7280-4ee5-9283-19d893d4efff admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:38.961486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:38.962135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:38.962414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:38.962744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] PATH_INFO: `/v3/projects/edc2309e5a6441cea851a35a9afd81f4/users/ea697cea748a4792a40753cf9a4c40a0/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:38.979838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc2309e5a6441cea851a35a9afd81f4, user_id=ea697cea748a4792a40753cf9a4c40a0, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:38.982486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:39.065856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1067/2128] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:38 2022] PUT /identity/v3/projects/edc2309e5a6441cea851a35a9afd81f4/users/ea697cea748a4792a40753cf9a4c40a0/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:39.069947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:39.081189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e6be-2ae3-40d3-83b3-29b02843c901 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:39.137960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab8d55-c455-4544-af68-c5dae9a268f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:39.138600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab8d55-c455-4544-af68-c5dae9a268f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:39.138883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab8d55-c455-4544-af68-c5dae9a268f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:39.139157 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab8d55-c455-4544-af68-c5dae9a268f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:39.139792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab8d55-c455-4544-af68-c5dae9a268f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:39.141380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab8d55-c455-4544-af68-c5dae9a268f6 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:39.151049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1062/2129] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:39.155268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:39.165667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8e64-8400-42b3-b85c-728f89751138 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:39.172742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:39.173391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:39.173670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:39.173941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] PATH_INFO: `/v3/projects/edc2309e5a6441cea851a35a9afd81f4/users/ea697cea748a4792a40753cf9a4c40a0/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:39.175901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc2309e5a6441cea851a35a9afd81f4, user_id=ea697cea748a4792a40753cf9a4c40a0, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:39.178556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:39.189632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1068/2130] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:39 2022] PUT /identity/v3/projects/edc2309e5a6441cea851a35a9afd81f4/users/ea697cea748a4792a40753cf9a4c40a0/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:39.200121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:39.200531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:39.200808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:39.232399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] MFA Rules not processed for user `ea697cea748a4792a40753cf9a4c40a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:39.235135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:39.245433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:39.318522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1063/2131] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:39.330144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:39.332143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:39.381076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:39.392575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d89e-e02a-49cc-b675-3a6b6b1fe5ce admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:39.396300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855b911-30e5-4803-b50e-76facdd9b24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:39.396945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b911-30e5-4803-b50e-76facdd9b24f service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:39.397226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b911-30e5-4803-b50e-76facdd9b24f service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:39.397498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855b911-30e5-4803-b50e-76facdd9b24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:39.406414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b911-30e5-4803-b50e-76facdd9b24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:39.407883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855b911-30e5-4803-b50e-76facdd9b24f service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:39.418632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1069/2132] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:39.798971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:39.800388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:39.866193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc501c6-5680-42b3-8a50-74b32d3db495 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:39.870717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:39.871671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:39.871953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:39.872222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] PATH_INFO: `/v3/users/fa7bf0b3e2da4289884170998b46eda0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:39.873337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7bf0b3e2da4289884170998b46eda0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:39.875305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:40.095385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7bf0b3e2da4289884170998b46eda0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:40.096059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7bf0b3e2da4289884170998b46eda0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:40.203040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7bf0b3e2da4289884170998b46eda0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:40.203717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7bf0b3e2da4289884170998b46eda0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:40.217825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7bf0b3e2da4289884170998b46eda0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:40.230918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1064/2133] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:39 2022] DELETE /identity/v3/users/fa7bf0b3e2da4289884170998b46eda0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:40.235434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:40.235885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:40.235974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:40.255244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:40.256447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:40.325354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1070/2134] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:40.332226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:40.333701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:40.369707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:40.410934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddfab2-1048-4005-ba9a-56206bcc0045 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:40.410934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:40.410934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:40.410934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:40.411303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:40.418708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:40.420228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:40.432294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1065/2135] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:40.477984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:40.479687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:40.538994 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98da0-7688-478b-a9cd-33bf1db792ea None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:40.543614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:40.544233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:40.544516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:40.544790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:40.546726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:40.611876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:40.613329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:40.624834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1071/2136] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:40.994797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:40.996305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:41.012672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ddfb9-2e49-4c8a-b685-3fdf7140bd6c service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:41.017905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:41.018821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:41.019138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:41.025867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] PATH_INFO: `/v3/projects/b174270dbeea4c4bbe90bfbf3c09405f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:41.025867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b174270dbeea4c4bbe90bfbf3c09405f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:41.025867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:41.176281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b174270dbeea4c4bbe90bfbf3c09405f', 'request_id': 'req-fdce0ba7-37dc-431d-8132-cb952de173b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:41.183120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b174270dbeea4c4bbe90bfbf3c09405f', 'request_id': 'req-fdce0ba7-37dc-431d-8132-cb952de173b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:41.278594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b174270dbeea4c4bbe90bfbf3c09405f', 'request_id': 'req-fdce0ba7-37dc-431d-8132-cb952de173b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:41.290323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] The token cache is being invalidate because project b174270dbeea4c4bbe90bfbf3c09405f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:41.290684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:41.291358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:41.292833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1066/2137] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:40 2022] DELETE /identity/v3/projects/b174270dbeea4c4bbe90bfbf3c09405f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:41.296841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:41.308368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7987c-ace3-4424-b9da-04f03ecb3d89 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:41.348065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:41.366957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:41.367930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:41.369341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:41.369629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] PATH_INFO: `/v3/users/5d548d34281e488a8746a7ec65925180` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:41.370842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d548d34281e488a8746a7ec65925180)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:41.372814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:41.589306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d548d34281e488a8746a7ec65925180'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.080719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d548d34281e488a8746a7ec65925180'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.080719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d548d34281e488a8746a7ec65925180'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.080719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d548d34281e488a8746a7ec65925180'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.080719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ede7a9c0-502b-4786-b993-c6e8ef58787d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d548d34281e488a8746a7ec65925180'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.080719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1072/2138] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:41 2022] DELETE /identity/v3/users/5d548d34281e488a8746a7ec65925180 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:42.588532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:42.590733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:42.611033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce0ba7-37dc-431d-8132-cb952de173b9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:42.692220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:42.692984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:42.693938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:42.694314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] PATH_INFO: `/v3/projects/3a8382b173d644f39fc2cff9da92258e` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:42.695834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8382b173d644f39fc2cff9da92258e)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:42.698128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:42.811459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8382b173d644f39fc2cff9da92258e', 'request_id': 'req-acbe72c6-d50b-403a-a0ae-d8ba33e14026'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.817943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8382b173d644f39fc2cff9da92258e', 'request_id': 'req-acbe72c6-d50b-403a-a0ae-d8ba33e14026'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.819823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:42.872713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8382b173d644f39fc2cff9da92258e', 'request_id': 'req-acbe72c6-d50b-403a-a0ae-d8ba33e14026'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.883142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] The token cache is being invalidate because project 3a8382b173d644f39fc2cff9da92258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:42.883422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.884027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-acbe72c6-d50b-403a-a0ae-d8ba33e14026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:42.886217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1067/2139] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:42 2022] DELETE /identity/v3/projects/3a8382b173d644f39fc2cff9da92258e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:42.891416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:42.896950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:42.896950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:42.912998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:42.914239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:42.975125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1073/2140] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:42.983115 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:42.983404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:42.983680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.003731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:43.005972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:43.014085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1068/2141] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:43.018173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.028865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8340b-d665-4475-b82c-2063a83d423c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.033663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.034257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.034573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.034846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.035772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:43.036078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.037664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.049467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1074/2142] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:43.053843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.063406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768d4b4-ef18-4bc2-9b9f-2d2e4ddbb37b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.068001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.068588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.068866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.069135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.069759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.071774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.139381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1069/2143] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:43 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:43.147666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.158949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657328f3-ca65-4aef-87cb-eefa610640a9 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.204484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:43.218998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.219613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.219894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.220243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.220832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.222767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.323945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1075/2144] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:43 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:43.328036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.339380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237a51-00a0-4611-b8e8-c3f0cb3d2c6c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.344405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.344999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.345278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.345598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.346236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.347937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.358373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1070/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:43.362264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.372650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fb039-e419-4061-a2b2-50918497cb7c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.377344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb628f31-eedd-4b0f-87fd-6d864aa91e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.377934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628f31-eedd-4b0f-87fd-6d864aa91e37 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.378208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628f31-eedd-4b0f-87fd-6d864aa91e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.378502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628f31-eedd-4b0f-87fd-6d864aa91e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.379130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb628f31-eedd-4b0f-87fd-6d864aa91e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.380749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb628f31-eedd-4b0f-87fd-6d864aa91e37 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.392810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1076/2146] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:43.396955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.407211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455d1d6-8b9b-4111-ac86-78feb77f0740 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.412035 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.412669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.412944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.413215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] PATH_INFO: `/v3/projects/711182fd4a494c8e928dd97613f53c8d/users/fd1fa18f8cba4df29aed3c83175c7203/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.430160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711182fd4a494c8e928dd97613f53c8d, user_id=fd1fa18f8cba4df29aed3c83175c7203, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.430878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.524181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1071/2147] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:43 2022] PUT /identity/v3/projects/711182fd4a494c8e928dd97613f53c8d/users/fd1fa18f8cba4df29aed3c83175c7203/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:43.534714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.535264 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.535541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.563110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] MFA Rules not processed for user `fd1fa18f8cba4df29aed3c83175c7203`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:43.564322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:43.642101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1077/2148] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:43.646773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.708628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02f96-0a6f-47c0-b8c2-4c112cb86064 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.713312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.713906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.714179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.714446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.715094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.717023 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:43.801315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1072/2149] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:43 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:43.805437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:43.818003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31ec64-5123-4a89-883e-0b15fbe01a82 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:43.886925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:43.887669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:43.888047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:43.888320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:43.889121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:43.892487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:44.012505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1078/2150] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:43 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:44.013813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:44.024393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0add1-327d-4597-8b91-8500787e8238 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:44.029896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:44.030525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:44.030852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:44.031129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:44.031772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:44.033365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:44.045111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1073/2151] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:44.049263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:44.059627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5bf40-91c2-49c2-9c3d-21d290ccb6f1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:44.064559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:44.065208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:44.065489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:44.065764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] PATH_INFO: `/v3/projects/73987d79f3c94009b18807d27453544a/users/d7b6ae34bdc348ee8ea87000a9f4e116/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:44.089257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73987d79f3c94009b18807d27453544a, user_id=d7b6ae34bdc348ee8ea87000a9f4e116, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:44.089257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:44.193028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1079/2152] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:44 2022] PUT /identity/v3/projects/73987d79f3c94009b18807d27453544a/users/d7b6ae34bdc348ee8ea87000a9f4e116/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:44.196888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:44.207552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651b2d-0e1f-48f9-b454-30d629c68bfc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:44.258199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:44.267538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef43aa-fd56-430b-b618-89bb9a81381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:44.268172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef43aa-fd56-430b-b618-89bb9a81381e admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:44.268454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef43aa-fd56-430b-b618-89bb9a81381e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:44.271244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef43aa-fd56-430b-b618-89bb9a81381e admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:44.271244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef43aa-fd56-430b-b618-89bb9a81381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:44.271244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef43aa-fd56-430b-b618-89bb9a81381e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:44.281026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1074/2153] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:44.285519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:44.296580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516448f1-0ccd-4b4e-bcef-dcd12557b1c7 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:44.301238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:44.301872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:44.302148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:44.302415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] PATH_INFO: `/v3/projects/73987d79f3c94009b18807d27453544a/users/d7b6ae34bdc348ee8ea87000a9f4e116/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:44.304447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73987d79f3c94009b18807d27453544a, user_id=d7b6ae34bdc348ee8ea87000a9f4e116, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:44.307602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:44.317600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1080/2154] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:44 2022] PUT /identity/v3/projects/73987d79f3c94009b18807d27453544a/users/d7b6ae34bdc348ee8ea87000a9f4e116/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:44.329729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:44.330040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:44.330312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:44.363943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] MFA Rules not processed for user `d7b6ae34bdc348ee8ea87000a9f4e116`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:44.367592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:44.466947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1075/2155] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:44.477915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:44.480735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:44.501804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:44.555063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8999ae-1d15-489b-914a-2e504b1d9fbd admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:44.559978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:44.560592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:44.560870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:44.561139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:44.571275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:44.572724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:44.583123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1081/2156] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:45.718439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:45.750989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:45.761277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de6a4-8adb-4cfc-a7c2-e70477d66cdc service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:45.770103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:45.771401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:45.771830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:45.772108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:45.774317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:45.791176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc07b-9d84-4da5-b9c5-281ed03bc64c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:45.797676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:45.798400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:45.798807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:45.799153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] PATH_INFO: `/v3/users/fd1fa18f8cba4df29aed3c83175c7203` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:45.800291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1fa18f8cba4df29aed3c83175c7203)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:45.802251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:45.846844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:45.848463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c45a18-ccda-4874-8f81-1b1e24079bb9 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:45.859095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1082/2157] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:45.950172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1fa18f8cba4df29aed3c83175c7203'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:45.950996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1fa18f8cba4df29aed3c83175c7203'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.015672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1fa18f8cba4df29aed3c83175c7203'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.016216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1fa18f8cba4df29aed3c83175c7203'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.029710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1fa18f8cba4df29aed3c83175c7203'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.034077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:46.042807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1076/2158] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:45 2022] DELETE /identity/v3/users/fd1fa18f8cba4df29aed3c83175c7203 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:46.047142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:46.047435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:46.049075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:46.066719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:46.067908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:46.133831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1083/2159] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:46.144066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:46.145575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:46.206754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412859e4-cac1-4117-8705-e4c74e5e2c9e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:46.210459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:46.211098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:46.211373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:46.211639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:46.221948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:46.223428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:46.233814 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1077/2160] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:46.612693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:46.613740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:46.627229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320c997-7b78-4525-9b56-3d277885f2e5 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:46.632055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:46.632687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:46.632969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:46.633228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] PATH_INFO: `/v3/projects/711182fd4a494c8e928dd97613f53c8d` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:46.634339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=711182fd4a494c8e928dd97613f53c8d)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:46.636924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:46.782279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:46.786048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711182fd4a494c8e928dd97613f53c8d', 'request_id': 'req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.792869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711182fd4a494c8e928dd97613f53c8d', 'request_id': 'req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.856376 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711182fd4a494c8e928dd97613f53c8d', 'request_id': 'req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.867183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] The token cache is being invalidate because project 711182fd4a494c8e928dd97613f53c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:46.867475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.868100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:46.870244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1084/2161] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:46 2022] DELETE /identity/v3/projects/711182fd4a494c8e928dd97613f53c8d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:46.874434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:46.884132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfef57-faee-4755-b1dd-7f593a69864d service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:46.954180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:46.954842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:46.955125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:46.955396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] PATH_INFO: `/v3/users/d7b6ae34bdc348ee8ea87000a9f4e116` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:46.956533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b6ae34bdc348ee8ea87000a9f4e116)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:46.958693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:47.169093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b6ae34bdc348ee8ea87000a9f4e116'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:47.169750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b6ae34bdc348ee8ea87000a9f4e116'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:47.221216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b6ae34bdc348ee8ea87000a9f4e116'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:47.221893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b6ae34bdc348ee8ea87000a9f4e116'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:47.235664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1ee679e3-6a29-4be9-b2e2-53ece3c36da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b6ae34bdc348ee8ea87000a9f4e116'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:47.248890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1078/2162] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:46 2022] DELETE /identity/v3/users/d7b6ae34bdc348ee8ea87000a9f4e116 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:47.679800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:47.685993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:47.706368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275abaf-ade8-4d50-a9f5-ad2ca6001cfb admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:47.767878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:47.768645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:47.768849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:47.769147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] PATH_INFO: `/v3/projects/73987d79f3c94009b18807d27453544a` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:47.770306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73987d79f3c94009b18807d27453544a)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:47.772278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:47.920572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73987d79f3c94009b18807d27453544a', 'request_id': 'req-7dcd887d-2595-4ae0-beec-a849ee271763'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:47.927608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73987d79f3c94009b18807d27453544a', 'request_id': 'req-7dcd887d-2595-4ae0-beec-a849ee271763'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:48.055904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73987d79f3c94009b18807d27453544a', 'request_id': 'req-7dcd887d-2595-4ae0-beec-a849ee271763'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:48.067695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] The token cache is being invalidate because project 73987d79f3c94009b18807d27453544a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:48.067982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:48.068592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7dcd887d-2595-4ae0-beec-a849ee271763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:48.070069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1085/2163] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:47 2022] DELETE /identity/v3/projects/73987d79f3c94009b18807d27453544a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:48.076007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.076464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.076576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.103566 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:48.105248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:48.121106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:48.180669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1079/2164] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:48.192908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.192908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.192908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.214036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:48.215494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:48.226017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1086/2165] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:48.231225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.243985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9192-21d8-480f-9917-02ca47b9b7fc None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:48.249708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:48.250928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.251578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.251578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.252387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:48.252803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:48.254799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:48.275380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1080/2166] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:48.278541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.294637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87cfd7-fd99-4328-b02c-57bb7fc319ff None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:48.300175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:48.300901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.301050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.301320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.302098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:48.304072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:48.412808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1087/2167] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:48 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:48.417058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.427598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b44f5-0a65-48c7-8d1a-1047dc09399b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:48.490633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:48.491241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.491521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.491791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.492430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:48.494411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:48.588030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1081/2168] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:48 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:48.592759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.602958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab857050-d9df-43c4-8ff5-c11b9de46614 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:48.607661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:48.608396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.608671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.608938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.609733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:48.611510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:48.622926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1088/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:48.627274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.637955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db4b57-227b-4323-9c7d-711395fd05fb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:48.642592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337db0c3-753c-41d3-92c8-620e61c98e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:48.643183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db0c3-753c-41d3-92c8-620e61c98e21 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.643458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db0c3-753c-41d3-92c8-620e61c98e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.643726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db0c3-753c-41d3-92c8-620e61c98e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.644361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337db0c3-753c-41d3-92c8-620e61c98e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:48.645944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337db0c3-753c-41d3-92c8-620e61c98e21 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:48.657141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1082/2170] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:48.664430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.672265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918d85-518d-49b0-b17b-7f9426dc1d89 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:48.676979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:48.677623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.677904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.678177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] PATH_INFO: `/v3/projects/5324e94d88d442648988e45a86e9b055/users/cb24592eec994a8b989608de589a68b9/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.694042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5324e94d88d442648988e45a86e9b055, user_id=cb24592eec994a8b989608de589a68b9, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:48.696727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:48.776361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:48.784325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1089/2171] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:48 2022] PUT /identity/v3/projects/5324e94d88d442648988e45a86e9b055/users/cb24592eec994a8b989608de589a68b9/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:48.796172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:48.796607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:48.796887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:48.849738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] MFA Rules not processed for user `cb24592eec994a8b989608de589a68b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:48.851165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:48.942805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1083/2172] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:48.955519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:48.957364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:49.017115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d0aba-cb52-4b97-b0d2-9cfb7af3e74f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:49.020764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19634a38-83ad-4adc-a911-51e80ff55c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:49.021362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19634a38-83ad-4adc-a911-51e80ff55c8e service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:49.021639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19634a38-83ad-4adc-a911-51e80ff55c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:49.021908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19634a38-83ad-4adc-a911-51e80ff55c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:49.030125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19634a38-83ad-4adc-a911-51e80ff55c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:49.031558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19634a38-83ad-4adc-a911-51e80ff55c8e service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:49.040410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1090/2173] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:49.061049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:49.073042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:49.123865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ba597-bf55-4eac-a569-5f2d7a002f9c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:49.128652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:49.129279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:49.129557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:49.129827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] PATH_INFO: `/v3/users/cb24592eec994a8b989608de589a68b9` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:49.130986 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb24592eec994a8b989608de589a68b9)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:49.132896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:49.268572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb24592eec994a8b989608de589a68b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:49.269266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb24592eec994a8b989608de589a68b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:49.323946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb24592eec994a8b989608de589a68b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:49.324593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb24592eec994a8b989608de589a68b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:49.337196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb24592eec994a8b989608de589a68b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:49.350259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1084/2174] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:49 2022] DELETE /identity/v3/users/cb24592eec994a8b989608de589a68b9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:49.356153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:49.356438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:49.356733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:49.377851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:49.379411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:49.471465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1091/2175] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:49.483097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:49.485034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:49.553002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23009-00eb-45fb-ab7d-a302a7a76916 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:49.557049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8726bc3-828b-45ca-a8b0-ed4e8fd71e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:49.557657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8726bc3-828b-45ca-a8b0-ed4e8fd71e61 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:49.557997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8726bc3-828b-45ca-a8b0-ed4e8fd71e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:49.558302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8726bc3-828b-45ca-a8b0-ed4e8fd71e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:49.568399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8726bc3-828b-45ca-a8b0-ed4e8fd71e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:49.569937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8726bc3-828b-45ca-a8b0-ed4e8fd71e61 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:49.581371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1085/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:49.977531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:49.979042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:49.992129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e34c0-9cc1-437d-b82a-7da075218559 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:49.999438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.000163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.000470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.000743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] PATH_INFO: `/v3/projects/5324e94d88d442648988e45a86e9b055` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.001902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5324e94d88d442648988e45a86e9b055)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.003885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.125934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5324e94d88d442648988e45a86e9b055', 'request_id': 'req-2961a86c-bca4-43c3-b759-47575c05ed17'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.139423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5324e94d88d442648988e45a86e9b055', 'request_id': 'req-2961a86c-bca4-43c3-b759-47575c05ed17'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.226953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5324e94d88d442648988e45a86e9b055', 'request_id': 'req-2961a86c-bca4-43c3-b759-47575c05ed17'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.238830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] The token cache is being invalidate because project 5324e94d88d442648988e45a86e9b055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:50.239116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.239756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2961a86c-bca4-43c3-b759-47575c05ed17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.241457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1092/2177] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:49 2022] DELETE /identity/v3/projects/5324e94d88d442648988e45a86e9b055 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:50.246753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.247300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.247300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.269106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:50.270308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:50.302976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:50.334043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1086/2178] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:50.342876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.343880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.343880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.365091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:50.366285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:50.375244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1093/2179] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:50.379493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.390027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fc5db-874f-4e39-b6e9-847848e484ec None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.394699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.395301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.395574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.395838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.396500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:50.396797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.398383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.411428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1087/2180] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:53:50.415814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.437961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ff96b-1395-41e4-9f46-28a8e632f19b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.442809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.443470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.443751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.444022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.444691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.446601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.462951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:50.544084 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1094/2181] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:50 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:50.552297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.559046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964bd55-a6a7-47cf-abac-46de8a144401 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.598829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.601036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:50.619269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.619873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.620154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.620435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.621248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.623399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.670671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab187-bf94-4247-9d30-03cdde543418 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.675401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.676070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.676353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.676629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] PATH_INFO: `/v3/users/01d3002ec3a740abb88ee75681df650f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.677777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d3002ec3a740abb88ee75681df650f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.679757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.705983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1088/2182] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:50 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:50.710111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.720524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ef73-ab4e-4695-a77c-7a9b46fd68ae admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.725171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.725750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.726028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.726295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.727008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.728720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.740952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1089/2183] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:50.744824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.755079 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbdc3c-f2a8-4d65-a20e-bb9a15fc2e4e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.761739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.762361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.762673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.762947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.763590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.765190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.775818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1090/2184] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:50.780489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:50.791545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01a812-9466-4277-8f4b-16287eae6ca7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:50.797605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f989b-9738-4d01-a264-58587b17dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:50.798265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f989b-9738-4d01-a264-58587b17dd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.798573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f989b-9738-4d01-a264-58587b17dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.798850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f989b-9738-4d01-a264-58587b17dd0c admin admin] PATH_INFO: `/v3/projects/6c313a2002a048ce9169e785a81b1740/users/362c9973c4734e86b650a8cdb464319f/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.814901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f989b-9738-4d01-a264-58587b17dd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c313a2002a048ce9169e785a81b1740, user_id=362c9973c4734e86b650a8cdb464319f, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:50.817587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f989b-9738-4d01-a264-58587b17dd0c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:50.869021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d3002ec3a740abb88ee75681df650f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.883127 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1091/2185] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:50 2022] PUT /identity/v3/projects/6c313a2002a048ce9169e785a81b1740/users/362c9973c4734e86b650a8cdb464319f/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:50.893370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.893654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.893951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.922604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] MFA Rules not processed for user `362c9973c4734e86b650a8cdb464319f`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:50.923806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:50.935728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d3002ec3a740abb88ee75681df650f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.940163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d3002ec3a740abb88ee75681df650f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.940825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d3002ec3a740abb88ee75681df650f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.952693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b73656c5-b704-43e3-b955-7bc01376270d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d3002ec3a740abb88ee75681df650f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:50.981362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1095/2186] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:50 2022] DELETE /identity/v3/users/01d3002ec3a740abb88ee75681df650f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:50.986010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c089da-458d-4779-a29a-fcb961686327 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:50.986296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c089da-458d-4779-a29a-fcb961686327 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:50.986600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c089da-458d-4779-a29a-fcb961686327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:50.989757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:51.001405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1092/2187] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:51.013693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-85c089da-458d-4779-a29a-fcb961686327 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:51.013693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-85c089da-458d-4779-a29a-fcb961686327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:51.013908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:51.015478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:51.079011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1096/2188] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:53:51.079730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604665de-3a0a-4643-8b67-ba31fe9d2360 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:51.091284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c089da-458d-4779-a29a-fcb961686327 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:51.094867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-85c089da-458d-4779-a29a-fcb961686327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:51.113867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:51.135914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:51.136979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:51.137274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:51.137546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:51.154485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c089da-458d-4779-a29a-fcb961686327 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:51.158147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:51.158793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:51.159074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:51.159347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:51.168685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:51.170115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:51.179923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1097/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:51.196091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:51.197567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:51.207160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1093/2190] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:53:51.784299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:51.786205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:51.804846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2efc3-ff09-46f4-9119-4ef3c9057207 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:51.812444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:51.813121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:51.813875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:51.814495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] PATH_INFO: `/v3/projects/67746069954443cabfb7f45cc71d13c4` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:51.815849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67746069954443cabfb7f45cc71d13c4)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:51.818851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:51.964530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67746069954443cabfb7f45cc71d13c4', 'request_id': 'req-bc236f58-b083-460e-af6e-77330564a9f9'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:51.974034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67746069954443cabfb7f45cc71d13c4', 'request_id': 'req-bc236f58-b083-460e-af6e-77330564a9f9'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.061263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67746069954443cabfb7f45cc71d13c4', 'request_id': 'req-bc236f58-b083-460e-af6e-77330564a9f9'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.072935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] The token cache is being invalidate because project 67746069954443cabfb7f45cc71d13c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:52.073224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.073888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.075894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1098/2191] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:51 2022] DELETE /identity/v3/projects/67746069954443cabfb7f45cc71d13c4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:52.079883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:52.092156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d68d2-98d8-4839-a705-cadcb9b18447 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:52.150929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:52.151548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:52.151825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:52.152177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] PATH_INFO: `/v3/users/6345258060b541ca8f9d07c9e2aa6bd7` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:52.153625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6345258060b541ca8f9d07c9e2aa6bd7)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:52.155659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:52.160429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:52.292435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6345258060b541ca8f9d07c9e2aa6bd7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.293705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6345258060b541ca8f9d07c9e2aa6bd7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.346901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6345258060b541ca8f9d07c9e2aa6bd7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.347540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6345258060b541ca8f9d07c9e2aa6bd7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.361335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6345258060b541ca8f9d07c9e2aa6bd7'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:52.373999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1094/2192] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:52 2022] DELETE /identity/v3/users/6345258060b541ca8f9d07c9e2aa6bd7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:52.833379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:52.834986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:52.850512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc236f58-b083-460e-af6e-77330564a9f9 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:52.913488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:52.914119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:52.914400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:52.914704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] PATH_INFO: `/v3/projects/7de34d0952c24da4ae6fe38f6a978e46` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:52.915826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de34d0952c24da4ae6fe38f6a978e46)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:52.918772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:53.055241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:53.059532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de34d0952c24da4ae6fe38f6a978e46', 'request_id': 'req-83166ddf-3bd5-45e6-a658-0ca5c905d499'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.066640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de34d0952c24da4ae6fe38f6a978e46', 'request_id': 'req-83166ddf-3bd5-45e6-a658-0ca5c905d499'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.140205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de34d0952c24da4ae6fe38f6a978e46', 'request_id': 'req-83166ddf-3bd5-45e6-a658-0ca5c905d499'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.152314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] The token cache is being invalidate because project 7de34d0952c24da4ae6fe38f6a978e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:53.152605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.153239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.155061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1099/2193] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:52 2022] DELETE /identity/v3/projects/7de34d0952c24da4ae6fe38f6a978e46 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:53.158867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:53.160640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:53.174069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45395-af86-4dcb-9973-20d4feed1037 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:53.238442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:53.239406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:53.239756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:53.240244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] PATH_INFO: `/v3/users/ea697cea748a4792a40753cf9a4c40a0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:53.241674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea697cea748a4792a40753cf9a4c40a0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:53.243830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:53.486345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea697cea748a4792a40753cf9a4c40a0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.487248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea697cea748a4792a40753cf9a4c40a0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.587253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea697cea748a4792a40753cf9a4c40a0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.587860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea697cea748a4792a40753cf9a4c40a0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.600781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-24b0bb3c-8ff2-4b6b-9e32-039e6e54249e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea697cea748a4792a40753cf9a4c40a0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:53.613824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1095/2194] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:53:53 2022] DELETE /identity/v3/users/ea697cea748a4792a40753cf9a4c40a0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:53:54.129302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:54.130904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:54.164250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83166ddf-3bd5-45e6-a658-0ca5c905d499 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:54.238226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:54.238975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:54.239323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:54.240207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] PATH_INFO: `/v3/projects/edc2309e5a6441cea851a35a9afd81f4` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:54.241338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc2309e5a6441cea851a35a9afd81f4)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:54.243348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:54.392301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc2309e5a6441cea851a35a9afd81f4', 'request_id': 'req-e64f80e9-ae74-49f3-8e68-56becd8eed37'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:54.398714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc2309e5a6441cea851a35a9afd81f4', 'request_id': 'req-e64f80e9-ae74-49f3-8e68-56becd8eed37'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:54.467294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc2309e5a6441cea851a35a9afd81f4', 'request_id': 'req-e64f80e9-ae74-49f3-8e68-56becd8eed37'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:54.478869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] The token cache is being invalidate because project edc2309e5a6441cea851a35a9afd81f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:53:54.483298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:54.483298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e64f80e9-ae74-49f3-8e68-56becd8eed37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:53:54.483298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1100/2195] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:53:54 2022] DELETE /identity/v3/projects/edc2309e5a6441cea851a35a9afd81f4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:54.487583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:54.488057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:54.488491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:54.497089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:54.509441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:54.510688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:54.599991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1096/2196] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:54.603513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:54.603804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:54.604081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:54.632093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:54.633509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:54.643233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1101/2197] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:54.647614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:54.657774 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf434-4fb9-40ec-8d63-4aa78932972f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:54.662816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:54.663418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:54.663698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:54.663972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:54.664618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:53:54.664922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:54.666580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:54.680151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1097/2198] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:53:54.685852 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:54.697131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce21f6-b6fa-4666-bb90-a01bff379899 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:54.702909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:54.705910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:54.705910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:54.705910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:54.705910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:54.706644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:54.814501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1102/2199] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:54 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:54.818426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:54.835662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712924-e525-4ce7-b994-0e72a7b8bed0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:54.904323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:54.905306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:54.905735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:54.906166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:54.907145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:54.909379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:54.993541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1098/2200] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:54 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:54.998971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.010683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890f856-df9f-41fd-89ac-165d4bcb8168 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.018067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.019079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.019369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.019644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.020302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.021910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.034566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1103/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:55.039024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.050091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548390f-1a9a-4c06-98ed-4e66a5a21189 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.055270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af87a-0eb9-44ab-9958-16a122824763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.056021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af87a-0eb9-44ab-9958-16a122824763 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.056406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af87a-0eb9-44ab-9958-16a122824763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.056805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af87a-0eb9-44ab-9958-16a122824763 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.057562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af87a-0eb9-44ab-9958-16a122824763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.059480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af87a-0eb9-44ab-9958-16a122824763 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.083714 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1099/2202] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:53:55.087737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.105811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8878-4f7d-4d57-a04b-ea66ae9a7573 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.112223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8903-6f4b-44e4-8f89-f4af9a160dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.112993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8903-6f4b-44e4-8f89-f4af9a160dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.113368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8903-6f4b-44e4-8f89-f4af9a160dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.113768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8903-6f4b-44e4-8f89-f4af9a160dbb admin admin] PATH_INFO: `/v3/projects/5c1d2b6ae7e240678f1d11009898f8f0/users/5dfae196155a45be8128bff9c73f02b9/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.131491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8903-6f4b-44e4-8f89-f4af9a160dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1d2b6ae7e240678f1d11009898f8f0, user_id=5dfae196155a45be8128bff9c73f02b9, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.134184 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8903-6f4b-44e4-8f89-f4af9a160dbb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.199853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:55.211089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1104/2203] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:55 2022] PUT /identity/v3/projects/5c1d2b6ae7e240678f1d11009898f8f0/users/5dfae196155a45be8128bff9c73f02b9/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:55.229452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.229928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.230303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.281652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094dd7-968f-449d-8605-336916e543e2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.281937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094dd7-968f-449d-8605-336916e543e2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.282410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094dd7-968f-449d-8605-336916e543e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.296166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] MFA Rules not processed for user `5dfae196155a45be8128bff9c73f02b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:55.297505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:55.304286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-69094dd7-968f-449d-8605-336916e543e2 None None] MFA Rules not processed for user `4f8130d23868424f9ee600cd8753b687`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:55.306503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-69094dd7-968f-449d-8605-336916e543e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:55.383857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:55.390086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1100/2204] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:55.392550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1105/2205] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:55.394323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.479175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcd7b2-a6b6-4406-b9b5-ebb10c4cb638 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.484896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.485705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.486084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.486455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.487268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.489672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.571547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1101/2206] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:55 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:55.576001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094dd7-968f-449d-8605-336916e543e2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.590451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094dd7-968f-449d-8605-336916e543e2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.663982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.664608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.664942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.665216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.665978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.668224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.796757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1106/2207] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:55 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:55.801142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.813547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68923048-1152-4691-b358-541dab2b3cf0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.818364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.818998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.819276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.819561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.820576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.822267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.834736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1102/2208] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:55.839132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.850544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed47d1-aac4-4231-bf00-29716347624a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.855424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8285-3996-4c17-88df-9689b3119b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.856033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8285-3996-4c17-88df-9689b3119b84 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.858115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8285-3996-4c17-88df-9689b3119b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.858115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8285-3996-4c17-88df-9689b3119b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.858115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8285-3996-4c17-88df-9689b3119b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.858895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8285-3996-4c17-88df-9689b3119b84 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:55.869164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1107/2209] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:55.873676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:55.883834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8f8d-4e91-4e17-a058-3baba60cbb75 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:55.889171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:55.894763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:55.894763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:55.894763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] PATH_INFO: `/v3/projects/7e55dbc1c918471ca5a465f44f648a7e/users/9e1552de2f1444c39d2c273b96a92e09/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:55.907608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e55dbc1c918471ca5a465f44f648a7e, user_id=9e1552de2f1444c39d2c273b96a92e09, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:55.910541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.006846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1103/2210] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:55 2022] PUT /identity/v3/projects/7e55dbc1c918471ca5a465f44f648a7e/users/9e1552de2f1444c39d2c273b96a92e09/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:56.015430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.015776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.016057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.048571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] MFA Rules not processed for user `9e1552de2f1444c39d2c273b96a92e09`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:56.050191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:56.166813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1108/2211] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:56.171817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:56.243772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d5c25-b623-45c4-b00e-7e9bf5b75405 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:56.252787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:56.252935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.253379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.253718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.254448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:56.256627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.376698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1104/2212] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:53:56 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:53:56.380757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:56.393013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e116dc-4db2-4d32-9f98-077b47d2e6a0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:56.463761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:56.468157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.468157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.468157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.468157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:56.468157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.551883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:56.556839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1109/2213] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:53:56 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:53:56.563334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:56.579513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e461834-f719-4bfb-b224-ecf73ae904e6 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:56.586451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:56.587280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.587578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.587910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.588618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:56.591564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.603371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1105/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:56.608643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:56.618950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8dd1-7343-4779-b17d-d0a3b96d0e91 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:56.624334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:56.624955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.625236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.625512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] PATH_INFO: `/v3/projects/7fcd6d2e06bd41f8aef58bfbf2d14037/users/04442f00b30e40ceb1e1dd961f59ca63/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.641186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcd6d2e06bd41f8aef58bfbf2d14037, user_id=04442f00b30e40ceb1e1dd961f59ca63, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:56.646812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.728357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1110/2215] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:56 2022] PUT /identity/v3/projects/7fcd6d2e06bd41f8aef58bfbf2d14037/users/04442f00b30e40ceb1e1dd961f59ca63/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:56.729287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:56.749125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb5845-0674-45b0-99ad-4e9398488ead admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:56.814902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:56.872424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f2877-bfaa-4024-a416-08a500cc47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:56.881016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f2877-bfaa-4024-a416-08a500cc47aa admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.881016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f2877-bfaa-4024-a416-08a500cc47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.881016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f2877-bfaa-4024-a416-08a500cc47aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.881016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f2877-bfaa-4024-a416-08a500cc47aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:56.882661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f2877-bfaa-4024-a416-08a500cc47aa admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.893467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1106/2216] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:53:56.897936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:56.909974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f2953-12c5-45f6-8a26-4e47cf9ffd45 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:56.915221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:56.915945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.916218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.916488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] PATH_INFO: `/v3/projects/7fcd6d2e06bd41f8aef58bfbf2d14037/users/04442f00b30e40ceb1e1dd961f59ca63/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.919076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcd6d2e06bd41f8aef58bfbf2d14037, user_id=04442f00b30e40ceb1e1dd961f59ca63, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:56.921644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:56.932203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1111/2217] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:53:56 2022] PUT /identity/v3/projects/7fcd6d2e06bd41f8aef58bfbf2d14037/users/04442f00b30e40ceb1e1dd961f59ca63/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:53:56.943890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826bba9-8427-45ba-85c5-a8359f2a5bbd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:56.944181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826bba9-8427-45ba-85c5-a8359f2a5bbd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:56.944456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826bba9-8427-45ba-85c5-a8359f2a5bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:56.972624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f826bba9-8427-45ba-85c5-a8359f2a5bbd None None] MFA Rules not processed for user `04442f00b30e40ceb1e1dd961f59ca63`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:56.973758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f826bba9-8427-45ba-85c5-a8359f2a5bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:57.048177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1107/2218] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:57.060205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:57.062031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:57.134996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84c19-5827-4c71-864e-960a15885c94 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:57.139760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:57.140487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:57.140764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:57.141032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:57.211902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:57.213968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:57.226529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1112/2219] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:53:57.548011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:57.548301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:57.548568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:57.569882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] MFA Rules not processed for user `a4cd49cba5ac42a999f95733cc3a466c`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:53:57.571188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:53:57.643065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1108/2220] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:53:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:53:59.253851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:53:59.262750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656800f-c62f-48cf-bf04-47e487ab1917 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:53:59.266594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f4e47-9301-45f9-9f38-243bccbf3400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:53:59.267260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f4e47-9301-45f9-9f38-243bccbf3400 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:53:59.267542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f4e47-9301-45f9-9f38-243bccbf3400 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:53:59.269380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f4e47-9301-45f9-9f38-243bccbf3400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:53:59.282283 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:53:59.331959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f4e47-9301-45f9-9f38-243bccbf3400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:53:59.333396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f4e47-9301-45f9-9f38-243bccbf3400 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:53:59.343455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1113/2221] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:53:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:01.208299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:01.221182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd685a-dda9-46a0-86ed-b9e54d566817 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:01.225721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:01.226616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:01.228065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:01.228065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:01.237823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:01.239666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:01.253204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1109/2222] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:04.162319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3753-0407-4003-89dd-b0fd76a12af7 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:04.162871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3753-0407-4003-89dd-b0fd76a12af7 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:04.162965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3753-0407-4003-89dd-b0fd76a12af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:04.185993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7bbc3753-0407-4003-89dd-b0fd76a12af7 None None] MFA Rules not processed for user `2dc650cb1f194ae5a40ac77e02f267a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:04.191210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7bbc3753-0407-4003-89dd-b0fd76a12af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:04.265474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1114/2223] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:06.320102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:06.403539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:06.464849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf363c4-e893-4123-9bcf-7047d3672d3e service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:06.469745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:06.470384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:06.470936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:06.471292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] PATH_INFO: `/v3/users/5dfae196155a45be8128bff9c73f02b9` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:06.472525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfae196155a45be8128bff9c73f02b9)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:06.474613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:06.679912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfae196155a45be8128bff9c73f02b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:06.681132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfae196155a45be8128bff9c73f02b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:06.747824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfae196155a45be8128bff9c73f02b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:06.748484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfae196155a45be8128bff9c73f02b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:06.764896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfae196155a45be8128bff9c73f02b9'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:06.790481 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1110/2224] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:54:06 2022] DELETE /identity/v3/users/5dfae196155a45be8128bff9c73f02b9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:06.795504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:06.796841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:06.797301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:06.828888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:06.830107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:06.896636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1115/2225] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:06.910754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:06.912660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:06.976853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919c02-eec6-4d2f-aaea-3bb064e9171c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:06.981067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:06.981701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:06.981980 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:06.982252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:06.991414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:06.992832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:07.002910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1111/2226] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:07.476530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:07.478054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:07.492653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8666a5-2770-44a2-a97b-7a63e0fdd271 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:07.497627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:07.498260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:07.498569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:07.498841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] PATH_INFO: `/v3/projects/5c1d2b6ae7e240678f1d11009898f8f0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:07.500221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1d2b6ae7e240678f1d11009898f8f0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:07.502921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:07.681358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1d2b6ae7e240678f1d11009898f8f0', 'request_id': 'req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:07.681358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1d2b6ae7e240678f1d11009898f8f0', 'request_id': 'req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:07.687334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:07.811954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1d2b6ae7e240678f1d11009898f8f0', 'request_id': 'req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:07.825790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] The token cache is being invalidate because project 5c1d2b6ae7e240678f1d11009898f8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:54:07.826089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:07.826787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:07.828371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1116/2227] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:54:07 2022] DELETE /identity/v3/projects/5c1d2b6ae7e240678f1d11009898f8f0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:07.833690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:07.850056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9adcf-aa5e-4155-8d2a-1b0f9b6bb64d service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:07.934901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:07.934901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:07.934901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:07.935174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:07.935253 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] PATH_INFO: `/v3/users/9e1552de2f1444c39d2c273b96a92e09` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:07.936444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1552de2f1444c39d2c273b96a92e09)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:07.938694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:08.224457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1552de2f1444c39d2c273b96a92e09'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:08.228385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1552de2f1444c39d2c273b96a92e09'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:08.392629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1552de2f1444c39d2c273b96a92e09'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:08.396102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1552de2f1444c39d2c273b96a92e09'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:08.411822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1552de2f1444c39d2c273b96a92e09'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:08.428056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1112/2228] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:54:07 2022] DELETE /identity/v3/users/9e1552de2f1444c39d2c273b96a92e09 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:09.048048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:09.051892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:09.064910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dcda3-9bc6-4559-a75a-4b4be0c94728 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:09.134373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:09.135035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:09.135382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:09.135562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] PATH_INFO: `/v3/projects/7e55dbc1c918471ca5a465f44f648a7e` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:09.137229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e55dbc1c918471ca5a465f44f648a7e)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:09.139995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:09.240529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e55dbc1c918471ca5a465f44f648a7e', 'request_id': 'req-664eadfc-4261-45c6-9482-b9cab2f12a64'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.247702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e55dbc1c918471ca5a465f44f648a7e', 'request_id': 'req-664eadfc-4261-45c6-9482-b9cab2f12a64'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.329819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e55dbc1c918471ca5a465f44f648a7e', 'request_id': 'req-664eadfc-4261-45c6-9482-b9cab2f12a64'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.342328 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] The token cache is being invalidate because project 7e55dbc1c918471ca5a465f44f648a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:54:09.342662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.343334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.344850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1117/2229] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:54:09 2022] DELETE /identity/v3/projects/7e55dbc1c918471ca5a465f44f648a7e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:09.349058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:09.350613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:09.365989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386eba9-c544-4020-83d8-213fe39d95dc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:09.450006 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:09.454623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:09.454623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:09.454623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] PATH_INFO: `/v3/users/04442f00b30e40ceb1e1dd961f59ca63` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:09.454623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04442f00b30e40ceb1e1dd961f59ca63)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:09.455418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:09.620163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04442f00b30e40ceb1e1dd961f59ca63'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.620888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04442f00b30e40ceb1e1dd961f59ca63'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.684249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04442f00b30e40ceb1e1dd961f59ca63'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.684983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04442f00b30e40ceb1e1dd961f59ca63'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.698459 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6afacd4a-50c0-4266-aff7-f942c70518f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04442f00b30e40ceb1e1dd961f59ca63'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:09.703826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:09.711595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1113/2230] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:54:09 2022] DELETE /identity/v3/users/04442f00b30e40ceb1e1dd961f59ca63 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:10.274569 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:10.276522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:10.291809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eadfc-4261-45c6-9482-b9cab2f12a64 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:10.358990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:10.359558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:10.359840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:10.360110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] PATH_INFO: `/v3/projects/7fcd6d2e06bd41f8aef58bfbf2d14037` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:10.363517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcd6d2e06bd41f8aef58bfbf2d14037)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:10.365503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:10.391485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:10.497738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcd6d2e06bd41f8aef58bfbf2d14037', 'request_id': 'req-42ff67ce-e09c-49a7-ae0b-a068620305e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:10.504611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcd6d2e06bd41f8aef58bfbf2d14037', 'request_id': 'req-42ff67ce-e09c-49a7-ae0b-a068620305e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:10.567398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcd6d2e06bd41f8aef58bfbf2d14037', 'request_id': 'req-42ff67ce-e09c-49a7-ae0b-a068620305e0'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:10.580656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] The token cache is being invalidate because project 7fcd6d2e06bd41f8aef58bfbf2d14037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:54:10.580945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:10.581819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-42ff67ce-e09c-49a7-ae0b-a068620305e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:10.583418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1118/2231] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:54:10 2022] DELETE /identity/v3/projects/7fcd6d2e06bd41f8aef58bfbf2d14037 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:10.588593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:10.589102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:10.589190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:10.630741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:10.631764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:10.718960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1114/2232] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:10.726458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:10.726801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:10.727251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:10.751516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:10.752741 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:10.761395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1119/2233] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:54:10.766025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:10.780044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cd743-5086-4489-a163-8a44c40daeb7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:10.786694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:10.787313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:10.787594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:10.787860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:10.788508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:54:10.788943 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:10.794030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:10.817056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1115/2234] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:54:10.822214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:10.835995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e11ad8-9515-453a-8474-7b5372e0b671 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:10.841064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:10.841813 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:10.842176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:10.842632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:10.843268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:10.845185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:10.932498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1120/2235] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:54:10 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:54:10.937367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:10.952757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b67e4b-cddd-4931-9a77-221acdad09a5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:11.048760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:11.050510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:11.050510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:11.050510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:11.051021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:11.053299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:11.146515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:11.150882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1116/2236] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:54:10 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:54:11.159614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15e8c-3822-40f6-a97f-9c5a3025abf9 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:11.166011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:11.166973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:11.167082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:11.167337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:11.168757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:11.170418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:11.185219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1121/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:54:11.186905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:11.197516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad4063-4143-4f48-a806-3e70393bb816 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:11.205817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9021c-0e1a-4081-aff1-60efaab81efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:11.206444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9021c-0e1a-4081-aff1-60efaab81efa admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:11.207080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9021c-0e1a-4081-aff1-60efaab81efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:11.207080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9021c-0e1a-4081-aff1-60efaab81efa admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:11.207673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9021c-0e1a-4081-aff1-60efaab81efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:11.209383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9021c-0e1a-4081-aff1-60efaab81efa admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:11.222284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1117/2238] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:54:11.226592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:11.240087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393785-3e3d-42dc-b4f5-f688eac4d841 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:11.246874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:11.247541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:11.247822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:11.248525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] PATH_INFO: `/v3/projects/0075979858604691ba017c40317f51ae/users/e6e2f67283834034a124721e93a6d00d/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:11.264957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075979858604691ba017c40317f51ae, user_id=e6e2f67283834034a124721e93a6d00d, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:11.268250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:11.343548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1122/2239] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:54:11 2022] PUT /identity/v3/projects/0075979858604691ba017c40317f51ae/users/e6e2f67283834034a124721e93a6d00d/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:11.366794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516eb68-1bae-4f71-a74c-7106e98b5366 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:11.368032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516eb68-1bae-4f71-a74c-7106e98b5366 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:11.368309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516eb68-1bae-4f71-a74c-7106e98b5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:11.414447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4516eb68-1bae-4f71-a74c-7106e98b5366 None None] MFA Rules not processed for user `e6e2f67283834034a124721e93a6d00d`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:11.418086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4516eb68-1bae-4f71-a74c-7106e98b5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:11.498924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:11.529982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1118/2240] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:11.545792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:11.548090 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:11.655614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d3a4a-d42e-4240-8166-dd4f1057de59 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:11.659675 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:11.660282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:11.661161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:11.661444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:11.673456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:11.675253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:11.691870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1123/2241] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:54:21.683275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:21.689547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:23.627416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59794c-be60-463e-a088-7eb655c51957 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:23.627973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59794c-be60-463e-a088-7eb655c51957 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:23.627973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59794c-be60-463e-a088-7eb655c51957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:23.647267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5f59794c-be60-463e-a088-7eb655c51957 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:23.648485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5f59794c-be60-463e-a088-7eb655c51957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:23.704655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1119/2242] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:54:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:23.753115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:23.754576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:23.846951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abed632-9063-4140-ba15-0e9d2662664f service glance] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:23.852428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:23.853045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:23.853390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:23.854036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:23.865594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:23.871784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:23.880598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1124/2243] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:54:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:54:31.825430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:31.826405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:31.826971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:31.869428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:31.871202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:31.881937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1120/2244] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:54:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:31.897314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:31.908995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548eb0c-82a3-4c16-8eda-1f3d5b84a613 service swift] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:31.915036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf8fec-09f3-4ae3-b57d-4292c86c44a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:31.915633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf8fec-09f3-4ae3-b57d-4292c86c44a6 service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:31.915961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf8fec-09f3-4ae3-b57d-4292c86c44a6 service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:31.916237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf8fec-09f3-4ae3-b57d-4292c86c44a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:31.925889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf8fec-09f3-4ae3-b57d-4292c86c44a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:31.927568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf8fec-09f3-4ae3-b57d-4292c86c44a6 service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:31.936873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1125/2245] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:54:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 02:54:41.854072 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=28 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:41.933365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=38 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:42.621461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:42.623353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:42.737275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd691-0fbb-4eaa-899d-d17f256816f6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:42.754226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:42.755328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:42.756040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:42.756604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] PATH_INFO: `/v3/users/362c9973c4734e86b650a8cdb464319f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:42.758233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=362c9973c4734e86b650a8cdb464319f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:42.760446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:43.378676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362c9973c4734e86b650a8cdb464319f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:43.378676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362c9973c4734e86b650a8cdb464319f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:43.644189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362c9973c4734e86b650a8cdb464319f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:43.644803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362c9973c4734e86b650a8cdb464319f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:43.657757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362c9973c4734e86b650a8cdb464319f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:43.670217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1121/2246] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:54:42 2022] DELETE /identity/v3/users/362c9973c4734e86b650a8cdb464319f => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:43.675231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:43.675764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:43.675764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:43.698513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:43.699714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:43.760504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1126/2247] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:43.770193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:43.771700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:43.862415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ced60-4025-4b90-a652-be778d0e5e13 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:43.867096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead3949-44aa-4022-860b-77e8556dabf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:43.868055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3949-44aa-4022-860b-77e8556dabf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:43.868560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3949-44aa-4022-860b-77e8556dabf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:43.869183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3949-44aa-4022-860b-77e8556dabf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:43.886417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead3949-44aa-4022-860b-77e8556dabf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:43.889634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead3949-44aa-4022-860b-77e8556dabf3 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:43.908412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1122/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:44.493498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:44.496408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:44.530814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c391e-e0b5-40e4-bfe0-bd8fabb66e95 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:44.539400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:44.540112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:44.555136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:44.556417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] PATH_INFO: `/v3/projects/6c313a2002a048ce9169e785a81b1740` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:44.559406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c313a2002a048ce9169e785a81b1740)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:44.565190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:44.834390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c313a2002a048ce9169e785a81b1740', 'request_id': 'req-985dfa5d-6819-498d-8577-ae1eed1eab23'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:44.840979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c313a2002a048ce9169e785a81b1740', 'request_id': 'req-985dfa5d-6819-498d-8577-ae1eed1eab23'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:44.916461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c313a2002a048ce9169e785a81b1740', 'request_id': 'req-985dfa5d-6819-498d-8577-ae1eed1eab23'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:44.928898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] The token cache is being invalidate because project 6c313a2002a048ce9169e785a81b1740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:54:44.929189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:44.929834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:44.931437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1127/2249] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:54:44 2022] DELETE /identity/v3/projects/6c313a2002a048ce9169e785a81b1740 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:46.361189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224971-591f-4199-9938-c632b57f4394 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:46.361699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224971-591f-4199-9938-c632b57f4394 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:46.361791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224971-591f-4199-9938-c632b57f4394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:46.381811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a5224971-591f-4199-9938-c632b57f4394 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:46.383026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a5224971-591f-4199-9938-c632b57f4394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:46.400921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:46.443907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1123/2250] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 14 02:54:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:46.458914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:46.460362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:46.530662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dfa5d-6819-498d-8577-ae1eed1eab23 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:46.535607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:46.536467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:46.536743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:46.537010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:46.544981 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:46.547266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:46.555229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1128/2251] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:54:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:54:49.763612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224971-591f-4199-9938-c632b57f4394 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:49.768765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a5224971-591f-4199-9938-c632b57f4394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:49.855403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224971-591f-4199-9938-c632b57f4394 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:49.861084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:49.861712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:49.862026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:49.862251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] PATH_INFO: `/v3/users/4f8130d23868424f9ee600cd8753b687` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:49.863495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8130d23868424f9ee600cd8753b687)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:49.865425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:50.100387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8130d23868424f9ee600cd8753b687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.101156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8130d23868424f9ee600cd8753b687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.221581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8130d23868424f9ee600cd8753b687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.222559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8130d23868424f9ee600cd8753b687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.240660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1e88f7fe-6e32-4661-8ab6-2b4f6981435e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8130d23868424f9ee600cd8753b687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.253675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1124/2252] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:54:49 2022] DELETE /identity/v3/users/4f8130d23868424f9ee600cd8753b687 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:50.508520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:50.519747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ae877-fd51-4a3e-9096-3a6e757988e5 service swift] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:50.531402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:50.581858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:50.582493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:50.582782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:50.583050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] PATH_INFO: `/v3/projects/38d1361415444603b6ec30f67ea98aa7` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:50.584172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d1361415444603b6ec30f67ea98aa7)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:50.586054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:50.693509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d1361415444603b6ec30f67ea98aa7', 'request_id': 'req-7bd0a791-49f8-4901-adef-4a6129c70b82'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.700273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d1361415444603b6ec30f67ea98aa7', 'request_id': 'req-7bd0a791-49f8-4901-adef-4a6129c70b82'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.775642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d1361415444603b6ec30f67ea98aa7', 'request_id': 'req-7bd0a791-49f8-4901-adef-4a6129c70b82'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.788222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] The token cache is being invalidate because project 38d1361415444603b6ec30f67ea98aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:54:50.788429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.789059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7bd0a791-49f8-4901-adef-4a6129c70b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:54:50.790656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1129/2253] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:54:50 2022] DELETE /identity/v3/projects/38d1361415444603b6ec30f67ea98aa7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:54:50.796591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:50.797040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:50.797133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:50.817310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:50.819552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:50.873165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:50.893046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1125/2254] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:54:50.900932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:50.901248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:50.901522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:50.921558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:50.922780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:50.930893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1130/2255] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:50.935246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:50.945439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc2eb2-60eb-4266-8047-127fb71d3532 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:50.950007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:50.950633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:50.950913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:50.951185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:50.952448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:54:50.952782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:50.954388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:50.967016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1126/2256] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:54:50.972160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:50.981568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c70c02-878f-4c9b-8f5d-c9156744a6ee None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:50.987203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:50.989423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:50.989423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:50.989423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:50.989423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:50.991211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.101223 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1131/2257] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:54:50 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:54:51.105396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.116215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8292-7362-4b16-bc2c-1f8dd433d8d8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:51.173539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:51.174142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.174419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.181125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.181125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:51.181125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.260219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1127/2258] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:54:51 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:54:51.265993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.276964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e47641-d35e-4c8d-9ba7-d633d8d84475 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:51.281697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:51.282296 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.282614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.282882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.283548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:51.285254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.296498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1132/2259] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:54:51.300582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.310757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cad164-838c-4d7c-8f7e-a41467a55ff8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:51.315975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b5ac-5210-417d-9a85-e07773cb6c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:51.316574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b5ac-5210-417d-9a85-e07773cb6c2e admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.316852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b5ac-5210-417d-9a85-e07773cb6c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.317120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b5ac-5210-417d-9a85-e07773cb6c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.317765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b5ac-5210-417d-9a85-e07773cb6c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:51.319401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b5ac-5210-417d-9a85-e07773cb6c2e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.330107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1128/2260] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:54:51.334329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.344700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a03ae-c12b-423e-9093-1aa0af3a7e9b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:51.349199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd1396-e0c9-4320-b78d-0000940683df None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.349560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd1396-e0c9-4320-b78d-0000940683df None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.349708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11535c-59e0-45ba-867b-9cb00cd11c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:51.349962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd1396-e0c9-4320-b78d-0000940683df None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.350362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11535c-59e0-45ba-867b-9cb00cd11c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.350670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11535c-59e0-45ba-867b-9cb00cd11c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.350942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11535c-59e0-45ba-867b-9cb00cd11c63 admin admin] PATH_INFO: `/v3/projects/fd8b5427c70248b49bcaf2ae4309d328/users/16620b95edda48f18ef0b359366b4a9b/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.351810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1129/2261] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:54:51.361105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.361429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.361660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.367293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11535c-59e0-45ba-867b-9cb00cd11c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8b5427c70248b49bcaf2ae4309d328, user_id=16620b95edda48f18ef0b359366b4a9b, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:51.370018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11535c-59e0-45ba-867b-9cb00cd11c63 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.383362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:51.384621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:51.453993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1130/2262] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:51.466448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1133/2263] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:54:51 2022] PUT /identity/v3/projects/fd8b5427c70248b49bcaf2ae4309d328/users/16620b95edda48f18ef0b359366b4a9b/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:54:51.467037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.468607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:51.474192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.474516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.474796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.504091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] MFA Rules not processed for user `16620b95edda48f18ef0b359366b4a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:51.505466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:51.516020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:51.526966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8230e67-147d-45dc-af7d-c98614a1452f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:51.536479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:54:51.572287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1134/2264] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:54:51.578017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02d2cd-fcb7-494a-a7cf-bb76142f8d7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:51.578655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d2cd-fcb7-494a-a7cf-bb76142f8d7d service glance] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.579209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d2cd-fcb7-494a-a7cf-bb76142f8d7d service glance] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.579209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d2cd-fcb7-494a-a7cf-bb76142f8d7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.587565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.588963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:51.645420 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0b5f-9489-4da3-850e-d00f6423bdc4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:51.649128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc800b-0cea-44d1-9ad2-4121040c5e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:51.649737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc800b-0cea-44d1-9ad2-4121040c5e80 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.650019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc800b-0cea-44d1-9ad2-4121040c5e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.650132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02d2cd-fcb7-494a-a7cf-bb76142f8d7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:51.650295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc800b-0cea-44d1-9ad2-4121040c5e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.651609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02d2cd-fcb7-494a-a7cf-bb76142f8d7d service glance] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.659799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc800b-0cea-44d1-9ad2-4121040c5e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:51.661773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc800b-0cea-44d1-9ad2-4121040c5e80 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:51.663703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1131/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:51.672502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1135/2266] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:54:51.880406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dae18-612c-4957-9c42-20b474ce89f1 None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.880954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dae18-612c-4957-9c42-20b474ce89f1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.881095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dae18-612c-4957-9c42-20b474ce89f1 None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.882934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1132/2267] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:54:51.888866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8b322-1495-45f6-99b0-550c1346ab41 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:51.889938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8b322-1495-45f6-99b0-550c1346ab41 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:51.890621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8b322-1495-45f6-99b0-550c1346ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:51.913333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1ad8b322-1495-45f6-99b0-550c1346ab41 None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:51.914579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1ad8b322-1495-45f6-99b0-550c1346ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:51.970506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1136/2268] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:51.985016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dae18-612c-4957-9c42-20b474ce89f1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:51.987110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-088dae18-612c-4957-9c42-20b474ce89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:52.008759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dae18-612c-4957-9c42-20b474ce89f1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:52.012591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd22170-2c55-47aa-8817-00c0818dffff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:52.013192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22170-2c55-47aa-8817-00c0818dffff service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:52.013469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22170-2c55-47aa-8817-00c0818dffff service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:52.013795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22170-2c55-47aa-8817-00c0818dffff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:52.022618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd22170-2c55-47aa-8817-00c0818dffff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:52.024033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd22170-2c55-47aa-8817-00c0818dffff service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:52.032634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1133/2269] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:52.126693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa951-51a1-4b50-b530-8e2ce6f2d3c6 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:52.128805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa951-51a1-4b50-b530-8e2ce6f2d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:52.128805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa951-51a1-4b50-b530-8e2ce6f2d3c6 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:52.128805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1137/2270] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:54:52.133846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b893e19-8178-4826-afc8-601852705469 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:52.134130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b893e19-8178-4826-afc8-601852705469 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:52.134414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b893e19-8178-4826-afc8-601852705469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:52.157336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9b893e19-8178-4826-afc8-601852705469 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:52.157336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9b893e19-8178-4826-afc8-601852705469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:52.164736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1134/2271] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:52.175916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa951-51a1-4b50-b530-8e2ce6f2d3c6 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:52.188308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691aa951-51a1-4b50-b530-8e2ce6f2d3c6 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:52.192040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeeab5-99ef-4500-bc19-1150198296f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:52.192656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeeab5-99ef-4500-bc19-1150198296f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:52.192939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeeab5-99ef-4500-bc19-1150198296f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:52.193210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeeab5-99ef-4500-bc19-1150198296f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:52.204092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeeab5-99ef-4500-bc19-1150198296f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:52.205508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeeab5-99ef-4500-bc19-1150198296f6 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:52.216097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1138/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:54:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:54:53.416354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:53.416845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:53.416940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:53.437959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] MFA Rules not processed for user `16620b95edda48f18ef0b359366b4a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:53.439185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:53.446075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1135/2273] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:56.208285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:56.209178 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:56.209680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:56.230651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:54:56.231890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:56.296669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1139/2274] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:54:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:54:56.309482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:54:56.310895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:54:56.382479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a143c78-b525-43c4-9edf-562e517ae06b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:54:56.387498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341a9a-d928-4b4c-8e74-5ac829ab21fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:54:56.388101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341a9a-d928-4b4c-8e74-5ac829ab21fa service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:54:56.388379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341a9a-d928-4b4c-8e74-5ac829ab21fa service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:54:56.388659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341a9a-d928-4b4c-8e74-5ac829ab21fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:54:56.396505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341a9a-d928-4b4c-8e74-5ac829ab21fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:54:56.398162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341a9a-d928-4b4c-8e74-5ac829ab21fa service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:54:56.406977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1136/2275] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:54:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:00.708537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:00.710064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:00.727593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:00.784243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5d43-dfc8-4fc2-887a-ed0d4bff75c4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:00.789833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:00.790641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:00.791045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:00.791465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] PATH_INFO: `/v3/users/e6e2f67283834034a124721e93a6d00d` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:00.793044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e2f67283834034a124721e93a6d00d)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:00.795170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:01.020449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e2f67283834034a124721e93a6d00d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:01.079456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e2f67283834034a124721e93a6d00d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:01.080096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e2f67283834034a124721e93a6d00d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:01.080716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e2f67283834034a124721e93a6d00d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:01.091752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e2f67283834034a124721e93a6d00d'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:01.128998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1140/2276] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:55:00 2022] DELETE /identity/v3/users/e6e2f67283834034a124721e93a6d00d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:01.133222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:01.133782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:01.133931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:01.150125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:01.157497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:01.158984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:01.234918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1137/2277] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:55:01.241958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:01.243467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:01.315857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0268d-f2a0-4a14-a6b0-77bc8ee5629b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:01.319368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b499c3-b76b-4b63-bd3c-b036f3eb5026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:01.319972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b499c3-b76b-4b63-bd3c-b036f3eb5026 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:01.320253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b499c3-b76b-4b63-bd3c-b036f3eb5026 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:01.320526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b499c3-b76b-4b63-bd3c-b036f3eb5026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:01.329875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b499c3-b76b-4b63-bd3c-b036f3eb5026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:01.331327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b499c3-b76b-4b63-bd3c-b036f3eb5026 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:01.340590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1141/2278] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:55:02.282453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:02.284423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:02.303850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2759b-7fed-470a-be34-d1e97d50def1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:02.320068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:02.320835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:02.321183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:02.321386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] PATH_INFO: `/v3/projects/0075979858604691ba017c40317f51ae` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:02.324526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0075979858604691ba017c40317f51ae)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:02.327410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:02.744796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0075979858604691ba017c40317f51ae', 'request_id': 'req-c2d81190-b443-4eb0-9021-9120e8bb6fc3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:02.754286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0075979858604691ba017c40317f51ae', 'request_id': 'req-c2d81190-b443-4eb0-9021-9120e8bb6fc3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:02.999229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0075979858604691ba017c40317f51ae', 'request_id': 'req-c2d81190-b443-4eb0-9021-9120e8bb6fc3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:03.012068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] The token cache is being invalidate because project 0075979858604691ba017c40317f51ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:55:03.012377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:03.013122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c2d81190-b443-4eb0-9021-9120e8bb6fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:03.015494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1138/2279] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:55:02 2022] DELETE /identity/v3/projects/0075979858604691ba017c40317f51ae => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:03.021011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.021626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.021626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.048330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:03.049654 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:03.089165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:03.120912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1142/2280] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:03.132795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.133098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.133388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.156621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:03.157841 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:03.167700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1139/2281] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:03.172735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.184069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdbfd2-5691-482b-b8ea-7549b7f7bbe0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.190212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.191072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.191638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.191912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.192570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:55:03.192902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.194646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.208956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1143/2282] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:55:03.214389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.224351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039c07c-930f-4992-bcf6-6d64433f3eff None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.229404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.230019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.230291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.231067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.231670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.234759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.320669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1140/2283] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:55:03 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:55:03.324835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.336952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ced3b-3f2b-419b-8db0-89d22ec0b1a1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.397408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.398023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.398306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.398621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.399276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.401191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.510787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1144/2284] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:55:03 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:55:03.511970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.522859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9369-6b2d-4849-8989-ff3a7e1d71ae admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.528535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.528535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.528766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.528892 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.529542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.532068 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.543383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1141/2285] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:55:03.547683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.558234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2101-5f55-48e9-8854-0082385fe520 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.563317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdf760-58ad-4ab1-8215-d9b4b936fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.563919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdf760-58ad-4ab1-8215-d9b4b936fa00 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.564198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdf760-58ad-4ab1-8215-d9b4b936fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.564495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdf760-58ad-4ab1-8215-d9b4b936fa00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.565132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdf760-58ad-4ab1-8215-d9b4b936fa00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.566753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdf760-58ad-4ab1-8215-d9b4b936fa00 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.578132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1145/2286] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:55:03.582641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.593392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c5781-25d6-4c57-8602-175c61569220 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.598400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.599110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.599393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.599682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] PATH_INFO: `/v3/projects/c0ae116686c0415c860ea9f100686e59/users/e28e3f3c7fd546d6b49e4693da8fe06a/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.617326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ae116686c0415c860ea9f100686e59, user_id=e28e3f3c7fd546d6b49e4693da8fe06a, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.620067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.713318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1142/2287] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:55:03 2022] PUT /identity/v3/projects/c0ae116686c0415c860ea9f100686e59/users/e28e3f3c7fd546d6b49e4693da8fe06a/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:03.719067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.719357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.719638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.743993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:03.745227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:03.846814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1146/2288] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:03.856324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:03.858102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:03.892336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:03.924907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496958-c48b-4a27-97da-4ed87ec681f0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:03.929629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c8a4-64f4-41db-b32e-49832256bea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:03.930241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c8a4-64f4-41db-b32e-49832256bea1 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:03.930600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c8a4-64f4-41db-b32e-49832256bea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:03.930878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c8a4-64f4-41db-b32e-49832256bea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:03.940761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83c8a4-64f4-41db-b32e-49832256bea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:03.942192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83c8a4-64f4-41db-b32e-49832256bea1 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:03.953138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1143/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:55:09.302548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:09.304700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:09.357241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:09.390903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d46bb-dc81-4a12-8ca5-e18755fd50ca None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:09.399235 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:09.400093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:09.400543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:09.400977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:09.403490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:09.417702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:09.419610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:09.432759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1147/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:55:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:55:11.911358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:11.912209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:11.912320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:11.943877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] MFA Rules not processed for user `e28e3f3c7fd546d6b49e4693da8fe06a`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:11.945184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:12.054948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1144/2291] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:12.059555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:12.072073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97330e79-1a51-4bc1-b4e6-1bf099c2f146 service placement] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:12.081730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:12.081730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:12.081730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:12.081730 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:12.082185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:12.083544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:12.206418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:12.206939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1148/2292] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:55:12.218125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9af0-63b2-4524-af1a-f9f7609bf7c2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:12.291579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:12.292384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:12.292758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:12.293290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:12.294146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:12.297691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:12.408755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1145/2293] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:55:12 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:55:12.412347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:12.423794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960f484-163f-402d-94ca-f9349ea89968 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:12.429352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:12.430119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:12.430523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:12.430900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:12.432206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:12.433944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:12.453418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:12.463977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1149/2294] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:55:12.465571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3242-cc57-4ca9-9827-3856bf554696 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:12.471938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:12.473096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:12.473601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:12.474133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] PATH_INFO: `/v3/projects/4642937c9bc142988dfa7b6b924574d1/users/cc82aa098eb848abbd9af10026fb3cfa/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:12.496190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4642937c9bc142988dfa7b6b924574d1, user_id=cc82aa098eb848abbd9af10026fb3cfa, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:12.499826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:12.612245 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1146/2295] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:55:12 2022] PUT /identity/v3/projects/4642937c9bc142988dfa7b6b924574d1/users/cc82aa098eb848abbd9af10026fb3cfa/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:12.616590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:12.627705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac99b41-e6e0-4582-a705-2bbd7a10ae83 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:12.694992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6bd3-a122-4579-bc50-ccf9ec80c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:12.695613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6bd3-a122-4579-bc50-ccf9ec80c50f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:12.695908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6bd3-a122-4579-bc50-ccf9ec80c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:12.696190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6bd3-a122-4579-bc50-ccf9ec80c50f admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:12.696840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6bd3-a122-4579-bc50-ccf9ec80c50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:12.698437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6bd3-a122-4579-bc50-ccf9ec80c50f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:12.708902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1150/2296] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:55:12.713169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:12.731679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e15d43-ca1c-4df3-b950-c7ff87715014 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:12.738275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:12.739160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:12.739580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:12.739894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] PATH_INFO: `/v3/projects/4642937c9bc142988dfa7b6b924574d1/users/cc82aa098eb848abbd9af10026fb3cfa/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:12.741881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4642937c9bc142988dfa7b6b924574d1, user_id=cc82aa098eb848abbd9af10026fb3cfa, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:12.744742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:12.756773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1147/2297] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:55:12 2022] PUT /identity/v3/projects/4642937c9bc142988dfa7b6b924574d1/users/cc82aa098eb848abbd9af10026fb3cfa/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:16.118460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6585a4-bcd7-4434-a610-8a599ef94689 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:16.119044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6585a4-bcd7-4434-a610-8a599ef94689 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:16.119044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6585a4-bcd7-4434-a610-8a599ef94689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:16.142946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2d6585a4-bcd7-4434-a610-8a599ef94689 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:16.144535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2d6585a4-bcd7-4434-a610-8a599ef94689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:16.220385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1151/2298] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 14 02:55:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:16.237969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:16.241056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:16.257932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:16.354408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bd0e-e1e7-4bd1-87d3-c885e73c9188 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:16.362571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:16.363149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:16.363434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:16.363711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:16.372625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:16.375276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:16.409336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1148/2299] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:19.572211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434adbb3-ff95-4afc-97e4-d17530c10234 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:19.572749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434adbb3-ff95-4afc-97e4-d17530c10234 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:19.572749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434adbb3-ff95-4afc-97e4-d17530c10234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:19.600993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-434adbb3-ff95-4afc-97e4-d17530c10234 None None] MFA Rules not processed for user `cc82aa098eb848abbd9af10026fb3cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:19.602213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-434adbb3-ff95-4afc-97e4-d17530c10234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:19.633209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:19.675303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1152/2300] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:19.689874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:19.691344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:19.749810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb419fc5-df2a-4f5d-8730-e3ccdd0e72fc service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:19.753634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:19.754261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:19.754570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:19.754849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:19.816413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:19.817856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:19.827223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1149/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:55:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:55:20.062124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2029714-3f84-4be2-a695-aa2507f8e547 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:20.062625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2029714-3f84-4be2-a695-aa2507f8e547 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:20.063095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2029714-3f84-4be2-a695-aa2507f8e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:20.088503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d2029714-3f84-4be2-a695-aa2507f8e547 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:20.089726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d2029714-3f84-4be2-a695-aa2507f8e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:20.097399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1153/2302] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:55:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:20.109861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:20.121565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572c05-865a-4207-9d16-ca2a3f334ec2 service glance] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:20.127474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:20.128105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:20.128406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:20.128754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:20.137200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:20.138818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:20.148357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1150/2303] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:29.085734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc12d-7ac0-476a-868d-31601da74418 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:29.086252 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc12d-7ac0-476a-868d-31601da74418 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:29.086336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc12d-7ac0-476a-868d-31601da74418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:29.132239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-96cfc12d-7ac0-476a-868d-31601da74418 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:29.134218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-96cfc12d-7ac0-476a-868d-31601da74418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:29.153188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1154/2304] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:55:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:29.162236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:29.176628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0e9bc-59de-44a1-a65d-7a0ebb3e6ccd service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:29.182946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:29.183819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:29.184293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:29.188338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:29.213910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:29.213910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:29.231429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1151/2305] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:30.644990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e442b7-69f5-4c13-983a-44e5c7bb8807 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:30.644990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e442b7-69f5-4c13-983a-44e5c7bb8807 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:30.645620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e442b7-69f5-4c13-983a-44e5c7bb8807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:30.691162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f9e442b7-69f5-4c13-983a-44e5c7bb8807 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:30.694367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f9e442b7-69f5-4c13-983a-44e5c7bb8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:30.710411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1155/2306] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 14 02:55:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:30.731979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:30.751823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c80c-98d7-4a32-b9fa-42dc54c92c83 service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:30.760228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:30.761188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:30.761705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:30.762165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:30.781128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:30.783227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:30.802891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1152/2307] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:31.681053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319d95-8c9d-406b-b4bc-abce58d58da5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:31.718255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319d95-8c9d-406b-b4bc-abce58d58da5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:31.718255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319d95-8c9d-406b-b4bc-abce58d58da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:31.718255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-57319d95-8c9d-406b-b4bc-abce58d58da5 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:31.718255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-57319d95-8c9d-406b-b4bc-abce58d58da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:31.718255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1156/2308] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:55:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:31.727956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:31.739926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42cf28-8e79-40eb-be41-a2e483966f2c service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:31.745594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:31.746202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:31.746514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:31.746855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:31.756843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:31.758586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:31.764239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:31.768105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1153/2309] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:32.926887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424427c7-de98-4c7d-a7cb-1c13e3bfcfe3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:32.927440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424427c7-de98-4c7d-a7cb-1c13e3bfcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:32.927440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424427c7-de98-4c7d-a7cb-1c13e3bfcfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:32.949028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-424427c7-de98-4c7d-a7cb-1c13e3bfcfe3 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:32.950240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-424427c7-de98-4c7d-a7cb-1c13e3bfcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:32.958695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1157/2310] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 14 02:55:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:32.971222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:32.981556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850e80-693d-4a1e-b12c-7c04e269e758 service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:32.987327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:32.987926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:32.988202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:32.988516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:32.996831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:32.998959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:33.007584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1154/2311] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:33.617888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0041-3574-4f62-8e7b-1094cac6e8fe None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:33.618201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0041-3574-4f62-8e7b-1094cac6e8fe None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:33.618455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0041-3574-4f62-8e7b-1094cac6e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:33.638657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-237c0041-3574-4f62-8e7b-1094cac6e8fe None None] MFA Rules not processed for user `e28e3f3c7fd546d6b49e4693da8fe06a`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:33.639429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-237c0041-3574-4f62-8e7b-1094cac6e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:33.646874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1158/2312] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:35.867287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:35.869012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:35.933560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7939-9ae2-496b-83e4-07c35e90abca service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:35.938668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:35.939291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:35.939576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:35.939849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] PATH_INFO: `/v3/users/16620b95edda48f18ef0b359366b4a9b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:35.940974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16620b95edda48f18ef0b359366b4a9b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:35.942928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:36.115637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16620b95edda48f18ef0b359366b4a9b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.116289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16620b95edda48f18ef0b359366b4a9b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.184693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16620b95edda48f18ef0b359366b4a9b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.185262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16620b95edda48f18ef0b359366b4a9b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.198135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16620b95edda48f18ef0b359366b4a9b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.210333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1155/2313] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:55:35 2022] DELETE /identity/v3/users/16620b95edda48f18ef0b359366b4a9b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:36.214789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:36.215298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:36.215398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:36.234786 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:36.235990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:36.293286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1159/2314] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:36.303465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:36.304855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:36.361878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4cd5-8a50-4bbf-96d4-87fca488c70c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:36.365635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ffa86-f93c-4282-a554-e7d31789acc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:36.366244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ffa86-f93c-4282-a554-e7d31789acc8 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:36.366558 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ffa86-f93c-4282-a554-e7d31789acc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:36.366833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ffa86-f93c-4282-a554-e7d31789acc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:36.377139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ffa86-f93c-4282-a554-e7d31789acc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:36.378602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ffa86-f93c-4282-a554-e7d31789acc8 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:36.388269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1156/2315] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:55:36.617348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:36.619906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:36.631094 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7118aa3-f146-4d1a-a657-1dae6ba6e605 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:36.635785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:36.636514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:36.636864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:36.637207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] PATH_INFO: `/v3/projects/fd8b5427c70248b49bcaf2ae4309d328` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:36.638402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8b5427c70248b49bcaf2ae4309d328)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:36.640830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:36.742888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8b5427c70248b49bcaf2ae4309d328', 'request_id': 'req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.749246 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8b5427c70248b49bcaf2ae4309d328', 'request_id': 'req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.809971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8b5427c70248b49bcaf2ae4309d328', 'request_id': 'req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.821477 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] The token cache is being invalidate because project fd8b5427c70248b49bcaf2ae4309d328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:55:36.821765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.822395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:55:36.823919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1160/2316] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:55:36 2022] DELETE /identity/v3/projects/fd8b5427c70248b49bcaf2ae4309d328 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:55:38.569633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f81c-1765-441d-b774-9a7abef4b35a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:38.570164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f81c-1765-441d-b774-9a7abef4b35a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:38.570283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f81c-1765-441d-b774-9a7abef4b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:38.590383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b2b9f81c-1765-441d-b774-9a7abef4b35a None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:38.591634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b2b9f81c-1765-441d-b774-9a7abef4b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:38.596295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:38.654142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1157/2317] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:55:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:38.670091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:55:38.672352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:38.690414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:38.775189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb7377-ba3a-41f9-84e1-6851f3d22eae admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:55:38.781966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717356-447a-423e-9dbf-7e994bdd32b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:55:38.782833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717356-447a-423e-9dbf-7e994bdd32b7 service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:38.783215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717356-447a-423e-9dbf-7e994bdd32b7 service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:38.783560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717356-447a-423e-9dbf-7e994bdd32b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:38.795970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717356-447a-423e-9dbf-7e994bdd32b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:55:38.798761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717356-447a-423e-9dbf-7e994bdd32b7 service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:55:38.820141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1161/2318] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:55:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:55:48.831474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=21 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:49.362621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=28 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:55:52.712133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:52.713429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:52.713711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:52.736021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] MFA Rules not processed for user `2dc650cb1f194ae5a40ac77e02f267a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:52.737242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:52.794632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1158/2319] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:55:54.869772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437982-5b06-41d2-a4cb-38c5ff8e04e1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:55:54.870271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437982-5b06-41d2-a4cb-38c5ff8e04e1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:55:54.870271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437982-5b06-41d2-a4cb-38c5ff8e04e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:55:54.889286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-25437982-5b06-41d2-a4cb-38c5ff8e04e1 None None] MFA Rules not processed for user `a4cd49cba5ac42a999f95733cc3a466c`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:55:54.891139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-25437982-5b06-41d2-a4cb-38c5ff8e04e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:55:54.944748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1162/2320] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:56:02.785359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=25 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:56:04.937833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=25 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:56:06.830084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:56:06.832067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:56:06.942770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a9d0c-b7d8-4377-945a-4b1eb156a5f2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:56:06.952735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:56:06.953564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:56:06.954109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:56:06.954750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:56:06.957624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:56:07.029309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:56:07.030940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1a0c5-675c-4ca9-954a-f2b5a4f3c6f5 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:56:07.041593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1159/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:56:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:56:11.620439 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:56:11.621060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:56:11.621060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:56:11.641885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] MFA Rules not processed for user `d12e9c1e41264150b70ab2cf08c78b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:56:11.643794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:56:11.703051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1163/2322] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:56:17.037100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=50 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:56:21.696180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=25 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:56:22.704334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:56:22.704781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:56:22.704781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:56:22.725318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] MFA Rules not processed for user `bbb87e23742c4fc99931477bce020e10`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:56:22.726565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:56:22.786559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1160/2323] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:56:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:56:32.778904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=25 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:00.969061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:00.970617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:00.982633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd721-5f25-447e-948e-9a513f2fd5fc None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:00.986020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:00.986909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:00.987883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:00.988177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:00.990035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:01.061552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:01.063020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:01.074657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1164/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:02.176100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:02.185726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acbb65-7d71-41f7-a8bc-da8df6bbdbdf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:02.189420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:02.190022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:02.190297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:02.190624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:02.192408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:02.260323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:02.261742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:02.271273 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1161/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:05.787872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:05.800466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e89e9-68a7-46cb-ae44-6ead9e0b5c38 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:05.804336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:05.804955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:05.805448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:05.805879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:05.807927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:05.823818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:05.825257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:05.841413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1165/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:06.010478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:06.012587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:06.025846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281ab62-0e0a-40b2-a3be-1c243c29516b service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:06.030492 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:06.031114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:06.031419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:06.031684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] PATH_INFO: `/v3/users/2dc650cb1f194ae5a40ac77e02f267a2` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:06.032789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc650cb1f194ae5a40ac77e02f267a2)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:06.034731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:06.232248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc650cb1f194ae5a40ac77e02f267a2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.232894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc650cb1f194ae5a40ac77e02f267a2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.298751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc650cb1f194ae5a40ac77e02f267a2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.299316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc650cb1f194ae5a40ac77e02f267a2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.312551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9a96d649-bfd3-4567-b021-c8d1b419612d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc650cb1f194ae5a40ac77e02f267a2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.325437 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1162/2327] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:06 2022] DELETE /identity/v3/users/2dc650cb1f194ae5a40ac77e02f267a2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:06.584082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:06.594794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccb2d9-9790-42e6-8a4f-c1661fe23cfe service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:06.658541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:06.659197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:06.659476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:06.659752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] PATH_INFO: `/v3/projects/8699604d52874cda8ff8c3c7b8e23345` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:06.660962 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8699604d52874cda8ff8c3c7b8e23345)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:06.663044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:06.788943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8699604d52874cda8ff8c3c7b8e23345', 'request_id': 'req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.797742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8699604d52874cda8ff8c3c7b8e23345', 'request_id': 'req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.880079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8699604d52874cda8ff8c3c7b8e23345', 'request_id': 'req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.892136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] The token cache is being invalidate because project 8699604d52874cda8ff8c3c7b8e23345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:06.892580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.894666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b5117dbe-774a-44b8-86ae-96e6ee3c1f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:06.894897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1166/2328] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:06 2022] DELETE /identity/v3/projects/8699604d52874cda8ff8c3c7b8e23345 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:06.900599 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:06.900979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:06.901499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:06.922715 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:06.923931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:06.989890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1163/2329] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:06.997721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:06.998001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:06.998269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.005927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:07.019356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:07.020715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:07.030860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1167/2330] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:07.035430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.045909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bf599-61f4-4305-b3fb-f6a3e5dab75b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.050577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.051185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.051466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.051739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.052381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:07.052864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.054637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.056536 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:07.074396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1164/2331] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:07.079052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.097834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fee2c-52b1-4e57-800e-5b329ccf86a3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.111629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.112247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.112530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.112791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.113425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.115358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.219665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1168/2332] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:07 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:07.223974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.231711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ac7b5-9f8e-4294-b1fc-0b45e706e664 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.301058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.301700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.301976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.302268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.303000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.305022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.406308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1165/2333] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:07 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:57:07.407514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.420069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e69c24-e817-4928-a898-e23878d2d014 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.424768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.425369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.425644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.425908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.426579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.428162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.438832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1169/2334] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:07.443081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.453663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f394-e771-4962-a41c-bbca4521d104 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.458792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52978dd3-dade-4318-9203-71a5f284f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.459399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978dd3-dade-4318-9203-71a5f284f30d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.459679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978dd3-dade-4318-9203-71a5f284f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.459953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52978dd3-dade-4318-9203-71a5f284f30d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.460700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978dd3-dade-4318-9203-71a5f284f30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.462952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52978dd3-dade-4318-9203-71a5f284f30d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.474739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1166/2335] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:07.479476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.490054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6684-94cd-4201-8ea8-48b3e0e7f5fc admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.495768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.496447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.496724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.497000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] PATH_INFO: `/v3/projects/31207fe5c1f34191be550be27aaaa579/users/e59801ea44e444349aee38afe8e95329/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.516454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31207fe5c1f34191be550be27aaaa579, user_id=e59801ea44e444349aee38afe8e95329, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.519366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.639103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1170/2336] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:07 2022] PUT /identity/v3/projects/31207fe5c1f34191be550be27aaaa579/users/e59801ea44e444349aee38afe8e95329/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:07.651278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.651853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.652191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.689842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] MFA Rules not processed for user `e59801ea44e444349aee38afe8e95329`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:07.691285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:07.771996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1167/2337] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:07.777582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:07.861271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c045-bf80-4ac3-959f-d522f3241823 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:07.870588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:07.873679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:07.873679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:07.873679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:07.873679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:07.874701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:07.992169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1171/2338] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:07 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:57:07.996936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:08.010344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5869-5c66-4744-85da-f3fda707029e None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:08.104658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:08.106589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.106589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.106589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.106589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:08.108364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:08.119912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:08.211128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1168/2339] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:07 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:08.213041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:08.224412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d2982-0767-4c65-962c-5e96f4e9754b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:08.236131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:08.240287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.240287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.240287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.240287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:08.240287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:08.255690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1172/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:08.257239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:08.269079 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43952d9-fae8-4865-b77f-fec02e97068a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:08.275900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:08.276571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.276854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.277132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] PATH_INFO: `/v3/projects/2ccf62708e5848178f8568b0728e8ce2/users/d291b98332044f6ebf400b840ef02c99/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.302064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccf62708e5848178f8568b0728e8ce2, user_id=d291b98332044f6ebf400b840ef02c99, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:08.308665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:08.394118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1169/2341] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:08 2022] PUT /identity/v3/projects/2ccf62708e5848178f8568b0728e8ce2/users/d291b98332044f6ebf400b840ef02c99/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:08.398550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:08.410036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02101cc7-ab27-4fe9-a420-0a2bc5d67952 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:08.476851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c107-2c33-4ebe-ac94-3783b1446dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:08.478430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c107-2c33-4ebe-ac94-3783b1446dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.478856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c107-2c33-4ebe-ac94-3783b1446dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.483320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c107-2c33-4ebe-ac94-3783b1446dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.483320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c107-2c33-4ebe-ac94-3783b1446dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:08.483320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c107-2c33-4ebe-ac94-3783b1446dd8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:08.492159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1173/2342] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:08.497446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:08.508839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c517c-4f37-4489-8ec1-77fcd82a5e58 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:08.514313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:08.515085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.515367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.515642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] PATH_INFO: `/v3/projects/2ccf62708e5848178f8568b0728e8ce2/users/d291b98332044f6ebf400b840ef02c99/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.517656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccf62708e5848178f8568b0728e8ce2, user_id=d291b98332044f6ebf400b840ef02c99, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:08.520379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:08.531970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1170/2343] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:08 2022] PUT /identity/v3/projects/2ccf62708e5848178f8568b0728e8ce2/users/d291b98332044f6ebf400b840ef02c99/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:08.548594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.548903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.549186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.571104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:08.580232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] MFA Rules not processed for user `d291b98332044f6ebf400b840ef02c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:08.581692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:08.652173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1174/2344] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:08.663402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:08.666307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:08.737826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fa2e-79e9-4a7a-ad1b-bf90b66446f8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:08.743600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dcec4-40a4-4d19-8b64-49bdc3dc11f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:08.744815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dcec4-40a4-4d19-8b64-49bdc3dc11f7 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:08.745266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dcec4-40a4-4d19-8b64-49bdc3dc11f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:08.745721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dcec4-40a4-4d19-8b64-49bdc3dc11f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:08.757919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dcec4-40a4-4d19-8b64-49bdc3dc11f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:08.759970 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dcec4-40a4-4d19-8b64-49bdc3dc11f7 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:08.770339 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1171/2345] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:09.833083 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:09.918036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08b9c-bb4b-4067-9ee4-04bbb49aae26 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:09.923039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:09.923795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:09.923987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:09.924261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] PATH_INFO: `/v3/users/e59801ea44e444349aee38afe8e95329` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:09.925462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59801ea44e444349aee38afe8e95329)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:09.928598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:10.190811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59801ea44e444349aee38afe8e95329'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:10.317581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59801ea44e444349aee38afe8e95329'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:10.318305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59801ea44e444349aee38afe8e95329'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:10.319072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59801ea44e444349aee38afe8e95329'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:10.328936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59801ea44e444349aee38afe8e95329'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:10.347389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1175/2346] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:09 2022] DELETE /identity/v3/users/e59801ea44e444349aee38afe8e95329 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:10.351898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:10.352448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:10.352448 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:10.371567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:10.372778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:10.434298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1172/2347] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:10.447390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:10.449004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:10.464165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:10.507515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba5b4-bd39-41c7-a6c4-4e6dacc1eee4 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:10.511952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:10.512558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:10.512844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:10.513119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:10.521942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:10.523403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:10.532839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1176/2348] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:11.003141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:11.004554 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:11.016295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0bf5d-de86-49e7-b3f0-b6790296d3da None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:11.020875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:11.021503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:11.021783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:11.022059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] PATH_INFO: `/v3/projects/31207fe5c1f34191be550be27aaaa579` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:11.023321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31207fe5c1f34191be550be27aaaa579)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:11.025799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:11.175338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31207fe5c1f34191be550be27aaaa579', 'request_id': 'req-07fbf5d5-dca5-400c-b7ea-52c21599fea0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.177262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:11.182030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31207fe5c1f34191be550be27aaaa579', 'request_id': 'req-07fbf5d5-dca5-400c-b7ea-52c21599fea0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.253137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31207fe5c1f34191be550be27aaaa579', 'request_id': 'req-07fbf5d5-dca5-400c-b7ea-52c21599fea0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.264153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] The token cache is being invalidate because project 31207fe5c1f34191be550be27aaaa579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:11.264435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.265039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.266546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1173/2349] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:11 2022] DELETE /identity/v3/projects/31207fe5c1f34191be550be27aaaa579 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:11.270491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:11.281171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e236e-0874-4865-bfeb-3eed94a5af31 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:11.343708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:11.344345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:11.344623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:11.344898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] PATH_INFO: `/v3/users/d291b98332044f6ebf400b840ef02c99` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:11.346008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d291b98332044f6ebf400b840ef02c99)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:11.347942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:11.558696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd291b98332044f6ebf400b840ef02c99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.645585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd291b98332044f6ebf400b840ef02c99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.646228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd291b98332044f6ebf400b840ef02c99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.646862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd291b98332044f6ebf400b840ef02c99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.655448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8d804056-3ac4-48c5-b06c-0943c79d820b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd291b98332044f6ebf400b840ef02c99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:11.673533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1177/2350] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:11 2022] DELETE /identity/v3/users/d291b98332044f6ebf400b840ef02c99 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:12.314201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:12.315736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:12.330719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbf5d5-dca5-400c-b7ea-52c21599fea0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:12.405126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:12.405753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:12.406066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:12.406325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] PATH_INFO: `/v3/projects/2ccf62708e5848178f8568b0728e8ce2` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:12.407477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccf62708e5848178f8568b0728e8ce2)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:12.409392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:12.509476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccf62708e5848178f8568b0728e8ce2', 'request_id': 'req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:12.515864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccf62708e5848178f8568b0728e8ce2', 'request_id': 'req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:12.578959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccf62708e5848178f8568b0728e8ce2', 'request_id': 'req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:12.590983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] The token cache is being invalidate because project 2ccf62708e5848178f8568b0728e8ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:12.591267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:12.591890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8fd0f2b4-4a7a-4ed6-91e8-80cd00bbd692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:12.593371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1174/2351] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:12 2022] DELETE /identity/v3/projects/2ccf62708e5848178f8568b0728e8ce2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:12.599614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:12.610701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:12.610701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:12.638742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:12.640121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:12.681824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:12.713239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1178/2352] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:12.721374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:12.725450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:12.725450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:12.744662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:12.746027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:12.754327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1175/2353] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:12.758884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:12.769416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6119f5-4eb2-4bda-9db6-482879da70af None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:12.775000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:12.775619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:12.776348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:12.776348 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:12.776799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:12.777098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:12.778718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:12.795887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1179/2354] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:12.797138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:12.807450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b867cc-15ff-4d08-b2d8-3c1e79144e46 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:12.815266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:12.815808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:12.816085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:12.816354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:12.816991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:12.818993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:12.943624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1176/2355] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:12 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:12.944761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:12.955526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07d594-f814-48e9-86f1-f1eae87c58a8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.014644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853e41-f3f7-44e9-9b87-0edf6c3ef03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.014791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853e41-f3f7-44e9-9b87-0edf6c3ef03f admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.014976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853e41-f3f7-44e9-9b87-0edf6c3ef03f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.015297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853e41-f3f7-44e9-9b87-0edf6c3ef03f admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.015955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853e41-f3f7-44e9-9b87-0edf6c3ef03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.017904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853e41-f3f7-44e9-9b87-0edf6c3ef03f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.098519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1180/2356] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:12 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:13.103908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.108968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000f25-744c-406e-a5d3-99f3058a4fb5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.109258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000f25-744c-406e-a5d3-99f3058a4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.109528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f000f25-744c-406e-a5d3-99f3058a4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.116642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171332a-e628-4a5d-b076-f8bcf35dc1c7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.122226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.122858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.123133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.123400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.124033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.125737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.130241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7f000f25-744c-406e-a5d3-99f3058a4fb5 None None] MFA Rules not processed for user `a4cd49cba5ac42a999f95733cc3a466c`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:13.131519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7f000f25-744c-406e-a5d3-99f3058a4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:13.136890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1177/2357] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:13.141021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.151259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32aefc-4a76-4db9-bdd7-7e817e6b2fc0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.156076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.160033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.160033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.160033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.160033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.160033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.171066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1178/2358] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:13.175420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.185918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcf94a-32cc-49a9-a559-f9fcd1b36776 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.190984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.191330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1181/2359] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:13.191656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.191965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.192314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] PATH_INFO: `/v3/projects/2f64170f65654fb7afd92bfd6f28e528/users/41d58721aff243e0a338711e40b061b3/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.208103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f64170f65654fb7afd92bfd6f28e528, user_id=41d58721aff243e0a338711e40b061b3, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.210958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.214223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:13.285863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1179/2360] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:13 2022] PUT /identity/v3/projects/2f64170f65654fb7afd92bfd6f28e528/users/41d58721aff243e0a338711e40b061b3/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:13.297494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.297903 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.298233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.327617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] MFA Rules not processed for user `41d58721aff243e0a338711e40b061b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:13.332200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:13.378196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:13.398180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1182/2361] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:13.403768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.468332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1819-a046-45d9-a013-ed1e91e4fa4c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.473287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.473885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.474161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.474429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.475167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.477220 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.590212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1180/2362] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:13 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:13.594249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.605811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54287dda-341c-4115-a2cf-8b17c29f03e4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.663812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.664863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.665269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.665818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.666586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.668540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.788531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1183/2363] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:13 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:13.792897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.803587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dbaa1-8a5d-48fd-b5df-4055f4cae9d5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.808723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.809359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.809638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.809914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.811057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.812178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.823981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1181/2364] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:13.828312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.839081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f2fc-0bb5-43d8-9dde-8d90422e4aaf admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:13.844104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:13.844761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:13.845040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:13.845340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] PATH_INFO: `/v3/projects/b7d4de20da714e0692445dfde5d057cf/users/081364ee41b242f688b1bf61f427d616/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:13.861106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d4de20da714e0692445dfde5d057cf, user_id=081364ee41b242f688b1bf61f427d616, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:13.863774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:13.956117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1184/2365] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:13 2022] PUT /identity/v3/projects/b7d4de20da714e0692445dfde5d057cf/users/081364ee41b242f688b1bf61f427d616/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:13.960142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:13.979495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48953f0-c55a-47ea-9561-fa190747a593 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:14.038936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca58a7-1dce-4149-994b-e35b95d85189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:14.039578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca58a7-1dce-4149-994b-e35b95d85189 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:14.039997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca58a7-1dce-4149-994b-e35b95d85189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:14.040396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca58a7-1dce-4149-994b-e35b95d85189 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:14.041308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca58a7-1dce-4149-994b-e35b95d85189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:14.042941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca58a7-1dce-4149-994b-e35b95d85189 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:14.055616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1182/2366] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:14.058015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:14.070027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fb309-7bd5-42a2-b3c7-ca2e9dca8575 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:14.075506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:14.076250 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:14.076600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:14.076881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] PATH_INFO: `/v3/projects/b7d4de20da714e0692445dfde5d057cf/users/081364ee41b242f688b1bf61f427d616/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:14.078841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d4de20da714e0692445dfde5d057cf, user_id=081364ee41b242f688b1bf61f427d616, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:14.081586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:14.093510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1185/2367] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:14 2022] PUT /identity/v3/projects/b7d4de20da714e0692445dfde5d057cf/users/081364ee41b242f688b1bf61f427d616/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:14.104871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:14.105162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:14.105439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:14.134596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] MFA Rules not processed for user `081364ee41b242f688b1bf61f427d616`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:14.135912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:14.188147 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:14.206731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1183/2368] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:14.217757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:14.219583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:14.287645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01261-fa84-4c73-95e1-0b6dfde59093 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:14.292843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:14.293641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:14.294116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:14.294458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:14.305512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:14.307116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:14.317613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1186/2369] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:14.875799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:14.945934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7511-f3a2-4a5f-9419-6247a40d1ea6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:14.951109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:14.951853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:14.952203 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:14.952547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] PATH_INFO: `/v3/users/41d58721aff243e0a338711e40b061b3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:14.953809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d58721aff243e0a338711e40b061b3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:14.955786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:14.998245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:15.000176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:15.053520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:15.081578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af546-aff4-4884-bcef-f6a9722584cc service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:15.088640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:15.089283 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:15.089561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:15.089828 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:15.091980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:15.153320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:15.155033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef5c4d-113c-4a4c-90ab-85d3f92ff184 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:15.165099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1187/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:15.166702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d58721aff243e0a338711e40b061b3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:15.167581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d58721aff243e0a338711e40b061b3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:15.247436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d58721aff243e0a338711e40b061b3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:15.248195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d58721aff243e0a338711e40b061b3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:15.266184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d58721aff243e0a338711e40b061b3'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:15.281664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1184/2371] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:14 2022] DELETE /identity/v3/users/41d58721aff243e0a338711e40b061b3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:15.288771 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:15.289057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:15.289375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:15.309034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:15.310241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:15.368172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1188/2372] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:15.378303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:15.379982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:15.439033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2155bb-f3a4-47aa-ac0f-f2685c0e5550 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:15.442843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:15.443450 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:15.443759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:15.444032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:15.454064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:15.455461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:15.465133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1185/2373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:15.894360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:15.895832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:15.909037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2b84e-de42-4702-ba06-e1bc8085a714 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:15.913710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:15.914456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:15.914763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:15.915035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] PATH_INFO: `/v3/projects/2f64170f65654fb7afd92bfd6f28e528` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:15.916446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f64170f65654fb7afd92bfd6f28e528)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:15.918338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:16.022098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f64170f65654fb7afd92bfd6f28e528', 'request_id': 'req-4685d181-82af-42b4-a30c-6b7d0c3b5c67'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.030826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f64170f65654fb7afd92bfd6f28e528', 'request_id': 'req-4685d181-82af-42b4-a30c-6b7d0c3b5c67'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.110358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f64170f65654fb7afd92bfd6f28e528', 'request_id': 'req-4685d181-82af-42b4-a30c-6b7d0c3b5c67'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.122666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] The token cache is being invalidate because project 2f64170f65654fb7afd92bfd6f28e528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:16.123027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.124010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.125546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1189/2374] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:15 2022] DELETE /identity/v3/projects/2f64170f65654fb7afd92bfd6f28e528 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:16.129576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:16.140371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14207f-7f84-4e19-9d85-9ad882e15f52 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:16.150544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:16.208081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:16.208718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:16.208997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:16.209353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] PATH_INFO: `/v3/users/081364ee41b242f688b1bf61f427d616` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:16.210563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081364ee41b242f688b1bf61f427d616)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:16.212869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:16.419765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081364ee41b242f688b1bf61f427d616'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.420417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081364ee41b242f688b1bf61f427d616'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.519944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081364ee41b242f688b1bf61f427d616'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.520590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081364ee41b242f688b1bf61f427d616'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.534138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2d1d522f-26bb-42cd-8a5f-87f1a1495d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081364ee41b242f688b1bf61f427d616'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:16.547081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1186/2375] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:16 2022] DELETE /identity/v3/users/081364ee41b242f688b1bf61f427d616 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:17.054447 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.056792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:17.067104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:17.073096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d181-82af-42b4-a30c-6b7d0c3b5c67 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.140089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.140733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.141010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.141345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] PATH_INFO: `/v3/projects/b7d4de20da714e0692445dfde5d057cf` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.142437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d4de20da714e0692445dfde5d057cf)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:17.144390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:17.252300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d4de20da714e0692445dfde5d057cf', 'request_id': 'req-0fcb8caa-885f-4250-ab1d-fbef6b52f404'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:17.259893 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d4de20da714e0692445dfde5d057cf', 'request_id': 'req-0fcb8caa-885f-4250-ab1d-fbef6b52f404'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:17.338987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d4de20da714e0692445dfde5d057cf', 'request_id': 'req-0fcb8caa-885f-4250-ab1d-fbef6b52f404'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:17.350977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] The token cache is being invalidate because project b7d4de20da714e0692445dfde5d057cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:17.351271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:17.352491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0fcb8caa-885f-4250-ab1d-fbef6b52f404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:17.354033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1190/2376] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:17 2022] DELETE /identity/v3/projects/b7d4de20da714e0692445dfde5d057cf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:17.358953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.359412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.359574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.380769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:17.381990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:17.471478 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1187/2377] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:17.481262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.481601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.481831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.513414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:17.516068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:17.533118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1191/2378] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:17.537751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.547926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b612e-1e57-41a4-9fa3-ae468e5115bf None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.552618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.553211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.553485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.553753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.554385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:17.554757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:17.556556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:17.577331 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1188/2379] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:17.577542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.584354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a381fb-c334-4b47-b10b-7b5afd441a29 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.590098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.590932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.591231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.591627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.592462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:17.594356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:17.706948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1192/2380] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:17 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:17.711172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.722209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a268d3-b5b5-4601-b142-a5a6c0345c73 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.742009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:17.783601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.784219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.784527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.784803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.785434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:17.787426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:17.888400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1189/2381] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:17 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:17.892713 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.903970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9f26-cab9-442d-94b3-3dea8cb29dc2 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.908719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.909782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.909782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.909992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.910605 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:17.912186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:17.923864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1193/2382] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:17.927817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.938013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86d363-7b89-447f-b92f-5b29c4bd8be7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.942666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ebb8e-6882-40c3-8f6a-3f3816717b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.943268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebb8e-6882-40c3-8f6a-3f3816717b7d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.943541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebb8e-6882-40c3-8f6a-3f3816717b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.945084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ebb8e-6882-40c3-8f6a-3f3816717b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:17.945084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ebb8e-6882-40c3-8f6a-3f3816717b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:17.946093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ebb8e-6882-40c3-8f6a-3f3816717b7d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:17.957425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1190/2383] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:17.962443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:17.972546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5723c9f-3ca9-4a5e-b11e-905c3501f92d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:17.980041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:17.980041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:17.980041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:17.980041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] PATH_INFO: `/v3/projects/b193c66c01ea4b53b145d3c22f98d98f/users/b05d0f669c124163b496a5bb65e1b293/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:18.000709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b193c66c01ea4b53b145d3c22f98d98f, user_id=b05d0f669c124163b496a5bb65e1b293, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:18.003441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:18.088011 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1194/2384] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:17 2022] PUT /identity/v3/projects/b193c66c01ea4b53b145d3c22f98d98f/users/b05d0f669c124163b496a5bb65e1b293/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:18.099470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:18.099753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:18.100029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:18.130531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] MFA Rules not processed for user `b05d0f669c124163b496a5bb65e1b293`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:18.131757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:18.199424 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1191/2385] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:18.210845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:18.213621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:18.245692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:18.271418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084ace-22d7-4579-bbf6-4595179a2dbd admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:18.276080 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:18.276689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:18.276971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:18.277249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:18.289957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:18.289957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:18.299192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1195/2386] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:23.738761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:23.740230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:23.813044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763480-6b28-4739-931d-29f0062d9eef None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:23.818519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:23.819123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:23.819404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:23.819677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:23.821477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:23.850046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:23.891773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:23.893414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:23.903204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1192/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:25.312767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:25.378678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040ee29-f09d-4bd2-9bcc-703bdf5fc91e service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:25.383076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:25.383698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:25.383972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:25.384244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] PATH_INFO: `/v3/users/b05d0f669c124163b496a5bb65e1b293` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:25.385587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05d0f669c124163b496a5bb65e1b293)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:25.387609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:25.627388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05d0f669c124163b496a5bb65e1b293'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:25.708846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:25.719620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05d0f669c124163b496a5bb65e1b293'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:25.720254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05d0f669c124163b496a5bb65e1b293'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:25.720870 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05d0f669c124163b496a5bb65e1b293'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:25.722169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3f15e-6cc2-49a3-afb5-84784fe27a59 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:25.729754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:25.730398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ab1eddd8-bf69-4b8a-8c2c-e12dc44d1867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05d0f669c124163b496a5bb65e1b293'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:25.730556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:25.730758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:25.731033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:25.733520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:25.752458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1196/2388] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:25 2022] DELETE /identity/v3/users/b05d0f669c124163b496a5bb65e1b293 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:25.756825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:25.757115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:25.757388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:25.777244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:25.778518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:25.805894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:25.807468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:25.818858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1193/2389] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:25.828562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:25.851823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1197/2390] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:25.864055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:25.865797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:25.927236 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a73b1e-6adb-4522-8511-56198477b0c2 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:25.985196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af5df9-0518-41e6-9537-8600a61a0d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:25.986031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af5df9-0518-41e6-9537-8600a61a0d7e service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:25.986324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af5df9-0518-41e6-9537-8600a61a0d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:25.986683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af5df9-0518-41e6-9537-8600a61a0d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:25.996987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af5df9-0518-41e6-9537-8600a61a0d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:25.998709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af5df9-0518-41e6-9537-8600a61a0d7e service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:26.010059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1194/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:26.613669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:26.615141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:26.632757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add99c-b9c2-40b7-ae7c-0d045dd94949 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:26.644630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:26.645262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:26.645703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:26.645804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] PATH_INFO: `/v3/projects/b193c66c01ea4b53b145d3c22f98d98f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:26.647000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b193c66c01ea4b53b145d3c22f98d98f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:26.648867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:26.759017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b193c66c01ea4b53b145d3c22f98d98f', 'request_id': 'req-57adf1d3-7868-4be6-8194-666838598ffe'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:26.765284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b193c66c01ea4b53b145d3c22f98d98f', 'request_id': 'req-57adf1d3-7868-4be6-8194-666838598ffe'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:26.824965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b193c66c01ea4b53b145d3c22f98d98f', 'request_id': 'req-57adf1d3-7868-4be6-8194-666838598ffe'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:26.836408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] The token cache is being invalidate because project b193c66c01ea4b53b145d3c22f98d98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:26.836702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:26.837345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-57adf1d3-7868-4be6-8194-666838598ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:26.839521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1198/2392] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:26 2022] DELETE /identity/v3/projects/b193c66c01ea4b53b145d3c22f98d98f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:26.845225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:26.845708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:26.846018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:26.867771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:26.869134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:26.886506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:26.929689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1195/2393] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:26.937678 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:26.937973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:26.938251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:26.971869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:26.973644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:26.982667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1199/2394] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:26.987172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:26.997274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2e4d7-b01b-4d1e-b658-eeb9e0c52ec1 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.002189 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.002836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.003119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.003399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.004185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:27.004495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.006259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.019293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1196/2395] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:27.028609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.040012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f8071-2edb-4215-b005-d01f73037958 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.046306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.046952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.047297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.047633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.052402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.052402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.184397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1200/2396] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:27.185802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.195639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106f4f8-a273-4341-b241-3e22da0bd2d2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.265373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.265985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.266264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.266564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.267200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.269112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.351510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1197/2397] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:27 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:57:27.358003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.368884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43212079-40c4-4c3c-851c-68b719200846 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.374670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.375281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.377829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.377829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.377829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.378276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.396053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1201/2398] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:27.397020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.411067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f43a7-c2ce-46f2-a51f-667fe7ad0c8f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.431680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40853d47-0c66-4f1b-9ec3-5ec4acbd93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.432315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853d47-0c66-4f1b-9ec3-5ec4acbd93ee admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.432581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853d47-0c66-4f1b-9ec3-5ec4acbd93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.432853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40853d47-0c66-4f1b-9ec3-5ec4acbd93ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.433553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853d47-0c66-4f1b-9ec3-5ec4acbd93ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.435193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40853d47-0c66-4f1b-9ec3-5ec4acbd93ee admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.459915 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1198/2399] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:27.461532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.472236 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dddfc-1315-4e2d-a751-2b9c69f89f92 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.477316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.477969 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.479124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.479467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] PATH_INFO: `/v3/projects/b463e97eb0ea4246a4d26683e7ab6d15/users/b813f9e97ea24f159faf2a97a896c9d5/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.505998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b463e97eb0ea4246a4d26683e7ab6d15, user_id=b813f9e97ea24f159faf2a97a896c9d5, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.508913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.614155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1202/2400] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:27 2022] PUT /identity/v3/projects/b463e97eb0ea4246a4d26683e7ab6d15/users/b813f9e97ea24f159faf2a97a896c9d5/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:27.625698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.625985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.626261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.655434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] MFA Rules not processed for user `b813f9e97ea24f159faf2a97a896c9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:27.656662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:27.724468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1199/2401] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:27.735750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.737470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:27.795872 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0ed78-7e69-496a-ad82-fb4502e1e74a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.799720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b422e-23f0-4bc5-b29b-c161c14247f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.800318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b422e-23f0-4bc5-b29b-c161c14247f2 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.800608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b422e-23f0-4bc5-b29b-c161c14247f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.800868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b422e-23f0-4bc5-b29b-c161c14247f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.810107 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b422e-23f0-4bc5-b29b-c161c14247f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.811731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b422e-23f0-4bc5-b29b-c161c14247f2 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:27.821231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1203/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:27.849069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:27.873725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:27.920353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335809b-485e-48b1-8ca0-40e8df87d9a0 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:27.925506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:27.926383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:27.926629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:27.926991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] PATH_INFO: `/v3/users/b813f9e97ea24f159faf2a97a896c9d5` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:27.928256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b813f9e97ea24f159faf2a97a896c9d5)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:27.930269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:28.168095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b813f9e97ea24f159faf2a97a896c9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:28.168788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b813f9e97ea24f159faf2a97a896c9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:28.234506 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b813f9e97ea24f159faf2a97a896c9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:28.235303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b813f9e97ea24f159faf2a97a896c9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:28.254614 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b813f9e97ea24f159faf2a97a896c9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:28.276543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1200/2403] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:27 2022] DELETE /identity/v3/users/b813f9e97ea24f159faf2a97a896c9d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:28.277817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:28.278104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:28.278375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:28.307661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:28.308888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:28.318691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:28.402502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1204/2404] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:28.413194 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:28.415051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:28.480930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed438a9-51d0-4a3a-8771-b2fbdbf625e0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:28.484880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e90354-cf27-4396-8f96-3b98056c358d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:28.485489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90354-cf27-4396-8f96-3b98056c358d service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:28.485886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90354-cf27-4396-8f96-3b98056c358d service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:28.486169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e90354-cf27-4396-8f96-3b98056c358d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:28.495926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90354-cf27-4396-8f96-3b98056c358d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:28.497361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e90354-cf27-4396-8f96-3b98056c358d service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:28.507409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1201/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:28.957587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:28.959067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:28.974436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef6363-6989-4148-915c-fa8ec484ad3a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:28.979869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:28.982551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:28.982551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:28.982551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] PATH_INFO: `/v3/projects/b463e97eb0ea4246a4d26683e7ab6d15` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:28.982551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b463e97eb0ea4246a4d26683e7ab6d15)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:28.984167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.087064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b463e97eb0ea4246a4d26683e7ab6d15', 'request_id': 'req-28385762-bcb6-4d64-b3f8-657a4755bfe8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:29.093471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b463e97eb0ea4246a4d26683e7ab6d15', 'request_id': 'req-28385762-bcb6-4d64-b3f8-657a4755bfe8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:29.193999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b463e97eb0ea4246a4d26683e7ab6d15', 'request_id': 'req-28385762-bcb6-4d64-b3f8-657a4755bfe8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:29.206211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] The token cache is being invalidate because project b463e97eb0ea4246a4d26683e7ab6d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:29.206450 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:29.207134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-28385762-bcb6-4d64-b3f8-657a4755bfe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:29.208636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1205/2406] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:28 2022] DELETE /identity/v3/projects/b463e97eb0ea4246a4d26683e7ab6d15 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:29.213838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.214313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.214407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.234872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:29.236060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:29.270999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:29.302369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1202/2407] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:29.310995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.311285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.311564 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.333567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:29.334814 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:29.343157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1206/2408] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:29.347430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.360919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51897f57-26f0-4e8c-a903-6d3ae381d15e None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:29.365825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:29.366382 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.366697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.366971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.367613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:29.367918 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:29.370410 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.383269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1203/2409] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:29.388194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.397630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de119de-1afe-4665-ad14-9df6b89dbd0f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:29.404745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:29.404745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.404745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.404745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.405134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:29.406407 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.501136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1207/2410] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:29 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:29.505399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.515769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436a17e-571a-490e-a55c-23e25b78c951 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:29.577798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:29.578747 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.579026 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.579300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.579933 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:29.581900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.663428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1204/2411] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:29 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:29.668326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.679277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b7ed3-a6c1-42ce-bbc6-7ccd1001765e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:29.684659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:29.685300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.685573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.685840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.686494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:29.688072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.699108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1208/2412] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:29.703351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.713354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356b33-bf65-4f24-9f5c-0a1dc8196a7a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:29.717990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1403a6-47c1-43e7-b415-10e6c254eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:29.718601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1403a6-47c1-43e7-b415-10e6c254eeaf admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.718883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1403a6-47c1-43e7-b415-10e6c254eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.719151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1403a6-47c1-43e7-b415-10e6c254eeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.719786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1403a6-47c1-43e7-b415-10e6c254eeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:29.721384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1403a6-47c1-43e7-b415-10e6c254eeaf admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.733796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1205/2413] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:29.739139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.748929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea6894-e003-4875-81a4-38d44179e311 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:29.753602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:29.754243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.754579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.754826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] PATH_INFO: `/v3/projects/16263ebb6582452ca7b8f724cc8300de/users/087e4e14f1284e5a9874aaedc7dd4600/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.770712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16263ebb6582452ca7b8f724cc8300de, user_id=087e4e14f1284e5a9874aaedc7dd4600, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:29.773364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:29.870432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1209/2414] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:29 2022] PUT /identity/v3/projects/16263ebb6582452ca7b8f724cc8300de/users/087e4e14f1284e5a9874aaedc7dd4600/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:29.880792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b6454-8607-48e0-a138-5eb4cf5d9a41 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:29.881078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b6454-8607-48e0-a138-5eb4cf5d9a41 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:29.881357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b6454-8607-48e0-a138-5eb4cf5d9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:29.913114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-da9b6454-8607-48e0-a138-5eb4cf5d9a41 None None] MFA Rules not processed for user `087e4e14f1284e5a9874aaedc7dd4600`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:29.914369 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-da9b6454-8607-48e0-a138-5eb4cf5d9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:29.980316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1206/2415] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:29.991466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:29.993317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:30.029687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:30.051802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe438e-3da1-43aa-8b7a-f5dc17e0458f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:30.055688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:30.056451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:30.056879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:30.057181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:30.066723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:30.068133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:30.077559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1210/2416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:33.820584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:33.821049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:33.821151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:33.842237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:33.843460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:33.891248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:33.913634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1207/2417] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:57:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:33.956448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:33.957924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:34.029751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce66e48-a085-43c1-aa04-0ebeb8a3b7f9 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:34.034853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:34.035466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:34.035748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:34.036022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:34.045216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:34.046932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:34.055432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1211/2418] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:57:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:57:42.476574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:42.609486 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545714a6-b588-4d84-9b3e-fdc8e01dae66 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:42.630675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:42.633286 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:42.633649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:42.634004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] PATH_INFO: `/v3/users/087e4e14f1284e5a9874aaedc7dd4600` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:42.636029 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087e4e14f1284e5a9874aaedc7dd4600)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:42.640445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:42.720961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:42.722589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:42.839328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087e4e14f1284e5a9874aaedc7dd4600'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:42.840067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087e4e14f1284e5a9874aaedc7dd4600'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:42.888418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ba0a3-23e6-437b-af7c-e11cb4c43078 service swift] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:42.897620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:42.898269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:42.898581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:42.898859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:42.902667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:42.915726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087e4e14f1284e5a9874aaedc7dd4600'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:42.916359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087e4e14f1284e5a9874aaedc7dd4600'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:42.935389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:42.940726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207a711-39c6-4405-a091-c151cbb61f54 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:42.947701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087e4e14f1284e5a9874aaedc7dd4600'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:42.974453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1212/2419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:42.983293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1208/2420] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:42 2022] DELETE /identity/v3/users/087e4e14f1284e5a9874aaedc7dd4600 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:42.987079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:42.987079 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:42.987887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:43.020639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:43.023783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:43.081842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:43.102732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1213/2421] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:43.121346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:43.125485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:43.195977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:43.197437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:43.252779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29fb93-b1a4-4ef4-8c79-720a5721a561 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:43.264178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:43.274662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:43.275316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:43.281544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:43.297899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:43.299624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:43.314852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1209/2422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:43.356138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd882c2-721b-4201-a00d-1690f9ef0184 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:43.361329 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:43.361988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:43.362228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:43.362530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:43.364418 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:43.393169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:43.395077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad5ae-66b7-45f5-a855-e46327705f4f service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:43.406593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1214/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:45.001178 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:45.002838 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:45.012312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:45.018553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf106a1-c6ca-4ca2-b1e6-1e066b5ee0e8 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:45.027321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:45.028021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.028307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.028613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] PATH_INFO: `/v3/projects/16263ebb6582452ca7b8f724cc8300de` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.029746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16263ebb6582452ca7b8f724cc8300de)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:45.032842 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:45.253908 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16263ebb6582452ca7b8f724cc8300de', 'request_id': 'req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:45.283608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16263ebb6582452ca7b8f724cc8300de', 'request_id': 'req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:45.373740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16263ebb6582452ca7b8f724cc8300de', 'request_id': 'req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:45.395477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] The token cache is being invalidate because project 16263ebb6582452ca7b8f724cc8300de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:45.395808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:45.403050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:45.406375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1210/2424] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:44 2022] DELETE /identity/v3/projects/16263ebb6582452ca7b8f724cc8300de => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:45.411247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99a966-4805-4e47-a042-8000b4a714e2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.411790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99a966-4805-4e47-a042-8000b4a714e2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.411790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99a966-4805-4e47-a042-8000b4a714e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.436453 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1c99a966-4805-4e47-a042-8000b4a714e2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:45.437719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1c99a966-4805-4e47-a042-8000b4a714e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:45.519793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:45.521912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:45.535941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1215/2425] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:45.544494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.545885 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.546275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.583508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:45.585888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:45.603169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1216/2426] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:45.606743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:45.631427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b80e-53f9-45dd-9436-9849103dcd40 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:45.653165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b079fe5-deaa-4187-9ab6-c8e106ff4fe0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:45.655392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:45.656076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.656357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.656811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.657571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:45.660570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:45.663302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:45.665803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:45.667279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.667755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.668334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.670407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:45.683869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1217/2427] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:45.685423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:45.687690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:45.690357 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:45.702915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337ba-b144-435a-87f0-293aefcc65bb admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:45.706658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1211/2428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:45.712861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:45.713380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.713680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.714142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.714900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:45.716989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:45.852385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1218/2429] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:45 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:45.853684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:45.866847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1a7b5-8668-4ba9-aa0a-2c0fbd8762b4 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:45.944734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:45.945496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:45.945797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:45.946059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:45.948825 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:45.958833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:46.038000 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:46.047064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1212/2430] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:45 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:46.050625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:46.068816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330227a-ad7f-41be-ad3a-7de409293928 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:46.076049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:46.076049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:46.076049 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:46.076379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:46.081239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:46.081239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:46.098737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1219/2431] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:46.102804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:46.114267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7ed9-1fd9-489b-b23c-d6f748868039 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:46.120672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c56f3-d665-40c1-8cdc-dd99855d3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:46.121555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c56f3-d665-40c1-8cdc-dd99855d3210 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:46.122158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c56f3-d665-40c1-8cdc-dd99855d3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:46.123180 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c56f3-d665-40c1-8cdc-dd99855d3210 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:46.123964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c56f3-d665-40c1-8cdc-dd99855d3210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:46.125991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c56f3-d665-40c1-8cdc-dd99855d3210 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:46.139806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1213/2432] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:57:46.144221 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:46.157204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dd7ae-a8d6-46fc-99d1-915691dcf70c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:46.168292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:46.169919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:46.169919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:46.169919 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] PATH_INFO: `/v3/projects/3af88efb083343a1b643ba8fccce46d8/users/90e01ba7b63147d38f12ce79f87a647f/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:46.208278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af88efb083343a1b643ba8fccce46d8, user_id=90e01ba7b63147d38f12ce79f87a647f, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:46.211517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:46.357091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1220/2433] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:46 2022] PUT /identity/v3/projects/3af88efb083343a1b643ba8fccce46d8/users/90e01ba7b63147d38f12ce79f87a647f/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:46.368791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:46.369095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:46.369351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:46.403682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] MFA Rules not processed for user `90e01ba7b63147d38f12ce79f87a647f`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:46.405009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:46.484590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1214/2434] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:46.497022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:46.499263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:46.522229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:46.567950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc201-b313-40f4-8e6e-051e593b64e0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:46.571860 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fffb26-7f8e-4cc8-8c63-f0ec10052189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:46.572449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffb26-7f8e-4cc8-8c63-f0ec10052189 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:46.572727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffb26-7f8e-4cc8-8c63-f0ec10052189 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:46.572992 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffb26-7f8e-4cc8-8c63-f0ec10052189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:46.585977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fffb26-7f8e-4cc8-8c63-f0ec10052189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:46.587484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fffb26-7f8e-4cc8-8c63-f0ec10052189 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:46.598153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1221/2435] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:51.864720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:51.866694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:51.925828 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404a7b-0ed5-49bf-9859-2e0d3009af2a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:51.929504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:51.930103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:51.930385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:51.930683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:51.932451 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.007171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:52.008655 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c6889-7bdd-4203-bc52-dc46acdd9cbe service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:52.020996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1215/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:52.261644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc41350-dca3-4e58-bab9-cb20a5ff4be3 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.262200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc41350-dca3-4e58-bab9-cb20a5ff4be3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.262389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc41350-dca3-4e58-bab9-cb20a5ff4be3 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.264013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1222/2437] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:57:52.272393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.272872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.273211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.296638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:52.297885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.327801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:52.376112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1216/2438] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:52.399108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc41350-dca3-4e58-bab9-cb20a5ff4be3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:52.403795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-edc41350-dca3-4e58-bab9-cb20a5ff4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.488349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc41350-dca3-4e58-bab9-cb20a5ff4be3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:52.492417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5468e9a-89a4-40de-9fef-a56bd78577f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:52.493041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5468e9a-89a4-40de-9fef-a56bd78577f5 service glance] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.493317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5468e9a-89a4-40de-9fef-a56bd78577f5 service glance] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.493591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5468e9a-89a4-40de-9fef-a56bd78577f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.501135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:52.506494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5468e9a-89a4-40de-9fef-a56bd78577f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:52.507958 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5468e9a-89a4-40de-9fef-a56bd78577f5 service glance] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:52.514799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed31ed-c30d-4ddd-9d3e-8017b164aa22 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:52.521078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:52.521803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.522182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.522539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] PATH_INFO: `/v3/users/90e01ba7b63147d38f12ce79f87a647f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.523273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1223/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:52.529878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e01ba7b63147d38f12ce79f87a647f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:52.529878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:52.739819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e01ba7b63147d38f12ce79f87a647f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:52.740526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e01ba7b63147d38f12ce79f87a647f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:52.765594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019b1d-661f-43c2-ba08-bf4aee4d00cd None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.765594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019b1d-661f-43c2-ba08-bf4aee4d00cd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.765594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019b1d-661f-43c2-ba08-bf4aee4d00cd None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.766874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1224/2440] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:57:52.771668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.771918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.772131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.799522 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] MFA Rules not processed for user `33c2eed340e0484880b561af4084ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:52.800720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.807929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1225/2441] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:52.819668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:52.821078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.829407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e01ba7b63147d38f12ce79f87a647f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:52.832591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e01ba7b63147d38f12ce79f87a647f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:52.832704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f50d88-87df-4598-a839-378cb7630b67 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:52.839561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:52.840192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.840481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.840754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.842667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.850134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-1d3dbff7-7699-417e-be6a-0fd6c1f98e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e01ba7b63147d38f12ce79f87a647f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:52.852996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:52.855726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9345299-74c0-4f6c-820d-123f8952b06d service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:52.865209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1226/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:52.868739 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1217/2443] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:52 2022] DELETE /identity/v3/users/90e01ba7b63147d38f12ce79f87a647f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:52.873817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.874199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.874498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.893614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:52.894894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:52.965668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02545d-e7bf-41ad-b688-f22079a523de None None] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.965952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02545d-e7bf-41ad-b688-f22079a523de None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.966835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02545d-e7bf-41ad-b688-f22079a523de None None] PATH_INFO: `/` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.969985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1218/2444] 10.222.0.27 () {54 vars in 921 bytes} [Wed Sep 14 02:57:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 02:57:52.979030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:52.984648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:52.984648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:52.993147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1227/2445] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:53.004246 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:53.005934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:53.007634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] MFA Rules not processed for user `aab0aa1e574a4549a1643bf0674df5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:53.009126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:53.087617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:53.106390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258f2a1-449e-4f6d-8265-ac1097ba0235 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:53.115908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4394e-6b93-4910-a236-747e5910c7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:53.116571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4394e-6b93-4910-a236-747e5910c7dd service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:53.116850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4394e-6b93-4910-a236-747e5910c7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:53.117121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4394e-6b93-4910-a236-747e5910c7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:53.133550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1219/2446] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Sep 14 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:53.134953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4394e-6b93-4910-a236-747e5910c7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:53.137092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4394e-6b93-4910-a236-747e5910c7dd service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:53.148598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:53.159275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1228/2447] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:53.161523 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b59a55-a015-42c4-b89c-774ecad563a7 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:53.165392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8679c-c703-43c8-ba82-c0af8999425f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:53.166460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8679c-c703-43c8-ba82-c0af8999425f service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:53.166460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8679c-c703-43c8-ba82-c0af8999425f service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:53.167027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8679c-c703-43c8-ba82-c0af8999425f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:53.180849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8679c-c703-43c8-ba82-c0af8999425f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:53.182247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8679c-c703-43c8-ba82-c0af8999425f service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:53.200564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1220/2448] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:57:53.289961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235ba35-97f3-4572-99c9-2acef20e9a79 None None] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:53.290397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235ba35-97f3-4572-99c9-2acef20e9a79 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:53.290689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235ba35-97f3-4572-99c9-2acef20e9a79 None None] PATH_INFO: `/` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:53.293100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1229/2449] 10.222.0.27 () {54 vars in 961 bytes} [Wed Sep 14 02:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 02:57:53.298371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:53.298683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:53.298958 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:53.330173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] MFA Rules not processed for user `01bcb3dcd2054cc3a8f03990d4dc0781`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:53.331304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:53.344217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:53.419054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1221/2450] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Sep 14 02:57:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:53.427760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235ba35-97f3-4572-99c9-2acef20e9a79 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:53.446632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235ba35-97f3-4572-99c9-2acef20e9a79 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:53.453575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:53.454214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:53.454526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:53.454951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:53.456874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:53.471113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:53.473897 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370c5ba-fd51-4cdb-8fc1-30c27d98643d service placement] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:53.518177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1230/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:57:53.785468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:53.789788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:53.829609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa2977-b475-437f-879b-9518fe2e40a0 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:53.859791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:53.859791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:53.859791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:53.859791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] PATH_INFO: `/v3/projects/3af88efb083343a1b643ba8fccce46d8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:53.860607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af88efb083343a1b643ba8fccce46d8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:53.863211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:54.021003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af88efb083343a1b643ba8fccce46d8', 'request_id': 'req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:54.027953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af88efb083343a1b643ba8fccce46d8', 'request_id': 'req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:54.114124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af88efb083343a1b643ba8fccce46d8', 'request_id': 'req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:54.128754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] The token cache is being invalidate because project 3af88efb083343a1b643ba8fccce46d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:54.129039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:54.129722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:54.131576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1222/2452] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:53 2022] DELETE /identity/v3/projects/3af88efb083343a1b643ba8fccce46d8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:54.874352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e49ff7-754c-4542-a8fc-2536c42f2cd2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:54.876088 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e49ff7-754c-4542-a8fc-2536c42f2cd2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:54.876594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e49ff7-754c-4542-a8fc-2536c42f2cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:54.915344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-66e49ff7-754c-4542-a8fc-2536c42f2cd2 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:54.916486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-66e49ff7-754c-4542-a8fc-2536c42f2cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:54.979274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1231/2453] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 14 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:57:54.993582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:54.994489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:55.075315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79fedc-3ffd-479a-a7a7-d9c2450c10b2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:55.096419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:55.097371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:55.097997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:55.098428 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:55.115172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:55.121351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:55.127482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1223/2454] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:57:56.424143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:56.424652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:56.424760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:56.445592 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:56.447361 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:56.456021 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1232/2455] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Sep 14 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:56.474078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:56.482857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c9102-cb42-445a-bc48-ad3ae5d22e25 service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:56.488895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:56.489583 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:56.490204 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:56.490570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:56.500595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:56.502169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:56.511811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1224/2456] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:57:56.759393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:56.761039 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:56.922309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826405e-0294-4ed5-b320-01978df30a56 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:56.936366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:56.938260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:56.938866 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:56.939615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] PATH_INFO: `/v3/users/bbb87e23742c4fc99931477bce020e10` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:56.941829 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb87e23742c4fc99931477bce020e10)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:56.944030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:57.153774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb87e23742c4fc99931477bce020e10'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:57.282111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb87e23742c4fc99931477bce020e10'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:57.282846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb87e23742c4fc99931477bce020e10'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:57.283475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb87e23742c4fc99931477bce020e10'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:57.295212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-dec9da6c-9f8d-46ed-bc29-b3654a7e2205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb87e23742c4fc99931477bce020e10'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:57.307095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:57.322517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1233/2457] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:57:56 2022] DELETE /identity/v3/users/bbb87e23742c4fc99931477bce020e10 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:57.668697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:57.684911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8868e63-3c6e-469d-ae69-b748c891fa75 service swift] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:57.695753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:57.858255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:57.859466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:57.859907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:57.860345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] PATH_INFO: `/v3/projects/c41ee9a31d894ff7bba265021cdca4fa` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:57.863330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41ee9a31d894ff7bba265021cdca4fa)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:57.865635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:58.063794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41ee9a31d894ff7bba265021cdca4fa', 'request_id': 'req-f9d4b399-a665-469b-9269-90cab9ab7ede'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:58.074718 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41ee9a31d894ff7bba265021cdca4fa', 'request_id': 'req-f9d4b399-a665-469b-9269-90cab9ab7ede'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:58.168267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41ee9a31d894ff7bba265021cdca4fa', 'request_id': 'req-f9d4b399-a665-469b-9269-90cab9ab7ede'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:58.181705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] The token cache is being invalidate because project c41ee9a31d894ff7bba265021cdca4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:57:58.182156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:58.183010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-f9d4b399-a665-469b-9269-90cab9ab7ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:57:58.185281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1225/2458] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:57:57 2022] DELETE /identity/v3/projects/c41ee9a31d894ff7bba265021cdca4fa => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:57:58.190674 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:58.191169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:58.191440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:58.217908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:58.219240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:58.303875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1234/2459] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:58.305810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:58.306307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:58.308741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:58.355338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:58.356578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:58.376335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1226/2460] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:58.380940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:58.392091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0dc65-4b73-40de-9ec4-2b89dd2d20da None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:58.407334 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:58.408538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:58.408823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:58.409096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:58.409767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:57:58.410433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:58.412679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:58.430501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1235/2461] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:57:58.436105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:58.445764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e9822-fc28-43ab-8c96-6477352c163c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:58.451839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:58.460897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:58.460897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:58.460897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:58.460897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:58.460897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:58.554514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1227/2462] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:58 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:57:58.563652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:58.577458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3702b7c-6073-4929-be30-9ac72d36e32e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:58.751671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:58.754054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:58.754930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:58.756053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:58.757777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:58.760818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:58.922139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1236/2463] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:58 2022] POST /identity/v3/users => generated 285 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:58.926638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:58.942124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30054-5bd3-41d1-809e-5fba68c20237 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:58.949847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:58.950642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:58.951018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:58.951391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:58.952148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:58.964146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:58.993988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1228/2464] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:58.998372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:59.012258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44993-e21d-4ebd-a3ed-52a67f85a6f5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:59.031437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c943f6-fcaf-4a01-a0ee-0bdbf618f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:59.032233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c943f6-fcaf-4a01-a0ee-0bdbf618f7de admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:59.032429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c943f6-fcaf-4a01-a0ee-0bdbf618f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:59.032706 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c943f6-fcaf-4a01-a0ee-0bdbf618f7de admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:59.033515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c943f6-fcaf-4a01-a0ee-0bdbf618f7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:59.035176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c943f6-fcaf-4a01-a0ee-0bdbf618f7de admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:59.060692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1237/2465] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:59.061767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:59.086172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b79342-217f-4359-933d-44f722036c62 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:59.104974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:59.106033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:59.106545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:59.107354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] PATH_INFO: `/v3/projects/6071fa72e06246cb9e5d73553ca72b5d/users/f9b80cb829fb4f8bad30926997f51461/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:59.142165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6071fa72e06246cb9e5d73553ca72b5d, user_id=f9b80cb829fb4f8bad30926997f51461, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:59.145263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:59.259864 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1229/2466] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:59 2022] PUT /identity/v3/projects/6071fa72e06246cb9e5d73553ca72b5d/users/f9b80cb829fb4f8bad30926997f51461/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:57:59.286665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:59.287606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:59.288070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:59.320017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] MFA Rules not processed for user `f9b80cb829fb4f8bad30926997f51461`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:57:59.321581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:57:59.387621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:59.408795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1238/2467] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:57:59.413132 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:59.455628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:57:59.486525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ea051-c4ae-4aec-bd4e-d87e4332940d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:59.492146 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:59.493099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:59.493445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:59.493786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:59.494577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:59.496906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:59.678182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1230/2468] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:57:59 2022] POST /identity/v3/projects => generated 369 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:57:59.683581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:59.695378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b447c3-56fb-4b6e-85d1-67b9470c4242 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:59.798644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:59.799877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:59.800474 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:59.800928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:59.802024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:59.804479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:59.916173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1239/2469] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:57:59 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:57:59.920556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:57:59.936582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158560d-e698-46d4-a7ed-65c78518bf12 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:57:59.944685 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:57:59.945565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:57:59.945988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:57:59.946418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:57:59.947346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:57:59.950199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:57:59.962512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1231/2470] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:57:59.967310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:00.004896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766670e1-9f64-4d75-97ea-03d3c7e7942a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:00.019210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:00.019905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:00.020186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:00.020445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] PATH_INFO: `/v3/projects/54a3391c6a6d4e9fa3cf08c277df9dce/users/5ba596b1123d441aaf89b38503958681/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:00.063615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a3391c6a6d4e9fa3cf08c277df9dce, user_id=5ba596b1123d441aaf89b38503958681, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:00.071187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:00.150496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1240/2471] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:57:59 2022] PUT /identity/v3/projects/54a3391c6a6d4e9fa3cf08c277df9dce/users/5ba596b1123d441aaf89b38503958681/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:00.154790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:00.169377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76604be9-e416-41e6-a36d-141dfb4325ed admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:00.316544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395294e-1445-4d33-b788-ac06eb301a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:00.316544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395294e-1445-4d33-b788-ac06eb301a17 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:00.316544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395294e-1445-4d33-b788-ac06eb301a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:00.316544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395294e-1445-4d33-b788-ac06eb301a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:00.317746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395294e-1445-4d33-b788-ac06eb301a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:00.317746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395294e-1445-4d33-b788-ac06eb301a17 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:00.334562 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1232/2472] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:00.336695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:00.352926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419879ec-2b68-4cd8-83ce-9b4fd26d07ad admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:00.361750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:00.361929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:00.362119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:00.362454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] PATH_INFO: `/v3/projects/54a3391c6a6d4e9fa3cf08c277df9dce/users/5ba596b1123d441aaf89b38503958681/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:00.364695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a3391c6a6d4e9fa3cf08c277df9dce, user_id=5ba596b1123d441aaf89b38503958681, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:00.367518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:00.388650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1241/2473] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:00 2022] PUT /identity/v3/projects/54a3391c6a6d4e9fa3cf08c277df9dce/users/5ba596b1123d441aaf89b38503958681/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:00.408150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:00.408150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:00.408150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:00.475676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] MFA Rules not processed for user `5ba596b1123d441aaf89b38503958681`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:00.479748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:00.597863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1233/2474] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:00.608251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:00.610151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:00.711876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00a48e-6fbc-47d4-83c4-0510add6f838 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:00.717305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:00.717989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:00.718406 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:00.718842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:00.732077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:00.735071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:00.755565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1242/2475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:01.549759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:01.551516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:01.609444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:01.693144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc0bfb-32b2-4cd4-a3b3-4ad3b9cf9235 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:01.699509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:01.708462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:01.708462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:01.708462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:01.736422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:01.781647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:01.796131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeff75-27bb-4e11-8108-b855e42e0845 service placement] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:01.836351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1234/2476] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:04.898505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:04.951933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:04.976535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a73c0-bc1d-46a9-95bf-aa6e7817442e service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:04.981661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:04.982810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:04.982810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:04.983123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] PATH_INFO: `/v3/users/f9b80cb829fb4f8bad30926997f51461` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:04.984233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b80cb829fb4f8bad30926997f51461)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:04.986371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:05.186408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b80cb829fb4f8bad30926997f51461'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:05.252707 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b80cb829fb4f8bad30926997f51461'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:05.253309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b80cb829fb4f8bad30926997f51461'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:05.253929 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b80cb829fb4f8bad30926997f51461'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:05.262193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b80cb829fb4f8bad30926997f51461'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:05.281879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1243/2477] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:04 2022] DELETE /identity/v3/users/f9b80cb829fb4f8bad30926997f51461 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:05.286350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:05.295858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:05.295858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:05.312087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:05.313612 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:05.388843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1235/2478] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:05.400799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:05.402817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:05.475886 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72356-64eb-4196-ae01-cf3575ad57c2 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:05.480454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:05.481443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:05.481731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:05.482006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:05.498287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:05.502425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:05.513655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1244/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:06.124851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:06.126710 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:06.164044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3292a88-9bcd-45ff-b09d-652648264d77 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:06.171646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:06.172653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:06.172935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:06.173272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] PATH_INFO: `/v3/projects/6071fa72e06246cb9e5d73553ca72b5d` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:06.174429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6071fa72e06246cb9e5d73553ca72b5d)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:06.176433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:06.316830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6071fa72e06246cb9e5d73553ca72b5d', 'request_id': 'req-d7aa5c87-2dff-4c32-bae5-973a98d89dea'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.323360 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6071fa72e06246cb9e5d73553ca72b5d', 'request_id': 'req-d7aa5c87-2dff-4c32-bae5-973a98d89dea'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.405474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6071fa72e06246cb9e5d73553ca72b5d', 'request_id': 'req-d7aa5c87-2dff-4c32-bae5-973a98d89dea'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.416522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] The token cache is being invalidate because project 6071fa72e06246cb9e5d73553ca72b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:06.416806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.417697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.419219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1236/2480] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:06 2022] DELETE /identity/v3/projects/6071fa72e06246cb9e5d73553ca72b5d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:06.423242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:06.433485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da691b-c39b-435e-88f4-8f05914996bd service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:06.447151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:06.449252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:06.501188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:06.501838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:06.502121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:06.502398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] PATH_INFO: `/v3/users/5ba596b1123d441aaf89b38503958681` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:06.503584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba596b1123d441aaf89b38503958681)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:06.504473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:06.505555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:06.511721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:06.527792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5c87-2dff-4c32-bae5-973a98d89dea admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:06.532569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:06.533199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:06.533476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:06.533750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] PATH_INFO: `/v3/users/e28e3f3c7fd546d6b49e4693da8fe06a` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:06.534905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28e3f3c7fd546d6b49e4693da8fe06a)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:06.536863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:06.724388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28e3f3c7fd546d6b49e4693da8fe06a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.725118 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28e3f3c7fd546d6b49e4693da8fe06a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.725881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba596b1123d441aaf89b38503958681'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.778920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28e3f3c7fd546d6b49e4693da8fe06a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.779565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28e3f3c7fd546d6b49e4693da8fe06a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.792626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28e3f3c7fd546d6b49e4693da8fe06a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.806373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1237/2481] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:06 2022] DELETE /identity/v3/users/e28e3f3c7fd546d6b49e4693da8fe06a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:06.840209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba596b1123d441aaf89b38503958681'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.840881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba596b1123d441aaf89b38503958681'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.841986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba596b1123d441aaf89b38503958681'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.850367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba596b1123d441aaf89b38503958681'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:06.871610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1245/2482] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:06 2022] DELETE /identity/v3/users/5ba596b1123d441aaf89b38503958681 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:07.178651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:07.178651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:07.259344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422d574-2bcb-4425-999f-14e52113df01 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:07.316911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:07.317533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.317798 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.318077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] PATH_INFO: `/v3/projects/c0ae116686c0415c860ea9f100686e59` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.319209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ae116686c0415c860ea9f100686e59)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:07.321096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:07.331375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:07.414211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:07.423226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:07.427729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ae116686c0415c860ea9f100686e59', 'request_id': 'req-40625548-a17a-401d-a659-295c3ff6428f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.430506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124514-31bf-435d-9879-b00bc88c86a4 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:07.435762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ae116686c0415c860ea9f100686e59', 'request_id': 'req-40625548-a17a-401d-a659-295c3ff6428f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.489260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:07.489945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.490222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.490524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] PATH_INFO: `/v3/projects/54a3391c6a6d4e9fa3cf08c277df9dce` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.491685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a3391c6a6d4e9fa3cf08c277df9dce)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:07.493624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:07.514082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ae116686c0415c860ea9f100686e59', 'request_id': 'req-40625548-a17a-401d-a659-295c3ff6428f'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.525279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] The token cache is being invalidate because project c0ae116686c0415c860ea9f100686e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:07.525597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.526229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.528275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1238/2483] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:07 2022] DELETE /identity/v3/projects/c0ae116686c0415c860ea9f100686e59 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:07.532099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:07.533395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:07.547323 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40625548-a17a-401d-a659-295c3ff6428f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:07.552053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:07.552647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.552925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.553197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] PATH_INFO: `/v3/users/cc82aa098eb848abbd9af10026fb3cfa` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.554310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc82aa098eb848abbd9af10026fb3cfa)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:07.556243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:07.606082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a3391c6a6d4e9fa3cf08c277df9dce', 'request_id': 'req-b0c4fe8a-ecc2-4578-8406-be965e007565'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.612176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a3391c6a6d4e9fa3cf08c277df9dce', 'request_id': 'req-b0c4fe8a-ecc2-4578-8406-be965e007565'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.681323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a3391c6a6d4e9fa3cf08c277df9dce', 'request_id': 'req-b0c4fe8a-ecc2-4578-8406-be965e007565'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.692894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] The token cache is being invalidate because project 54a3391c6a6d4e9fa3cf08c277df9dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:07.693404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.694038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b0c4fe8a-ecc2-4578-8406-be965e007565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.695616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1246/2484] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:07 2022] DELETE /identity/v3/projects/54a3391c6a6d4e9fa3cf08c277df9dce => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:07.701635 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4fe47-e053-4af7-8fc4-206f66c72059 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.701922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4fe47-e053-4af7-8fc4-206f66c72059 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.702196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4fe47-e053-4af7-8fc4-206f66c72059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.719461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc82aa098eb848abbd9af10026fb3cfa'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.720124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc82aa098eb848abbd9af10026fb3cfa'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.723164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a0a4fe47-e053-4af7-8fc4-206f66c72059 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:07.724383 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a0a4fe47-e053-4af7-8fc4-206f66c72059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:07.733017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:07.777698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc82aa098eb848abbd9af10026fb3cfa'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.778528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc82aa098eb848abbd9af10026fb3cfa'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.783074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1247/2485] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:07.791173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.791415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.791690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.793213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc82aa098eb848abbd9af10026fb3cfa'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:07.807418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1239/2486] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:07 2022] DELETE /identity/v3/users/cc82aa098eb848abbd9af10026fb3cfa => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:07.811787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:07.813106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:07.875608 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1248/2487] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:07.879822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:07.890706 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a5a9b-e472-40f4-b6b0-f5e1f619711f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:07.895416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:07.896016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.896297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.896571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.897217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:07.897531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:07.899162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:07.913140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1240/2488] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:58:07.918486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:07.928470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66726fd-241b-42bd-91b9-9d17f6192939 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:07.933565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:07.934076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:07.934419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:07.934744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:07.935392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:07.937302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.041557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1249/2489] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:07 2022] POST /identity/v3/projects => generated 401 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:08.043682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.055164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f64d-7e50-4a73-a7b2-80b0c7d524a9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.071845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.075583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:08.166852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:08.178315 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.179090 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.179375 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.179643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.180296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.182264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.198667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec71f-a5d6-442a-b80a-2f2e48a2ca56 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.203656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.204301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.204585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.204857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] PATH_INFO: `/v3/projects/4642937c9bc142988dfa7b6b924574d1` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.206558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4642937c9bc142988dfa7b6b924574d1)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.208821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.299787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1241/2490] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:08.313179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.314669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81e065-1f6d-4b21-99c6-04a57d7d76de admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.319497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.320221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.320431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.320704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.321356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.323131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.340182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1242/2491] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:08.341183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.346156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:08.351280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3024-02e4-4a6d-acd7-62a0b0e582f9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.357066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4642937c9bc142988dfa7b6b924574d1', 'request_id': 'req-3d34ca8a-72db-4c00-b635-d21262a058cb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:08.364003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4642937c9bc142988dfa7b6b924574d1', 'request_id': 'req-3d34ca8a-72db-4c00-b635-d21262a058cb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:08.412116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.412723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.413003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.413274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.413911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.415574 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.427249 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1243/2492] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:08.430654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.440812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd54cd6-53db-43fe-9b69-caae15ce0095 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.445499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2923b9-b7af-4309-8504-07da312b671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.446138 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2923b9-b7af-4309-8504-07da312b671d admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.446419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2923b9-b7af-4309-8504-07da312b671d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.446722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2923b9-b7af-4309-8504-07da312b671d admin admin] PATH_INFO: `/v3/projects/4794df72ef1949049dd6e180aab9ca03/users/9f9a3b9910e84f2db2b4d19e3e7d0168/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.462791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2923b9-b7af-4309-8504-07da312b671d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4794df72ef1949049dd6e180aab9ca03, user_id=9f9a3b9910e84f2db2b4d19e3e7d0168, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.465940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2923b9-b7af-4309-8504-07da312b671d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.468655 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4642937c9bc142988dfa7b6b924574d1', 'request_id': 'req-3d34ca8a-72db-4c00-b635-d21262a058cb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:08.480201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] The token cache is being invalidate because project 4642937c9bc142988dfa7b6b924574d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:08.480918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:08.481754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3d34ca8a-72db-4c00-b635-d21262a058cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:08.483700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1250/2493] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:08 2022] DELETE /identity/v3/projects/4642937c9bc142988dfa7b6b924574d1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:08.488441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6f19-fe02-4cea-a1af-73ac7adb19a0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.488728 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6f19-fe02-4cea-a1af-73ac7adb19a0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.488996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6f19-fe02-4cea-a1af-73ac7adb19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.509489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-f0cd6f19-fe02-4cea-a1af-73ac7adb19a0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:08.510801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f0cd6f19-fe02-4cea-a1af-73ac7adb19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:08.523548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1251/2494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:08.535103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.535861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.536401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.539173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1244/2495] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:08 2022] PUT /identity/v3/projects/4794df72ef1949049dd6e180aab9ca03/users/9f9a3b9910e84f2db2b4d19e3e7d0168/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:08.553527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.554079 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.554274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.563349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:08.564545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:08.584276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] MFA Rules not processed for user `9f9a3b9910e84f2db2b4d19e3e7d0168`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:08.585497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:08.624015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1252/2496] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:08.628204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.637667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2f795-a6d6-4e08-b3c2-877d6a0ad581 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.642429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.643160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.643443 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.643714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.644356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:08.644653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.646233 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.651004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1245/2497] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:08.655845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.657205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:08.659102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1253/2498] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:58:08.663166 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.671466 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebada615-ad7b-4432-9aab-2fc73655e100 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.673658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6aa70-91e4-4fa9-8c29-aa303a4416aa admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.676081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.676675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.676953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.677224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.677845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.678314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.678922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.679201 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.679494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.679757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.680112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.681980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.762359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1246/2499] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:08.766173 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.783324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:08.799319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1254/2500] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:08.818177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.832638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa334a-aee7-451d-9334-d90691f4516c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.881637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab23fcf-4369-48f5-b6c1-5331c9e504de admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.887352 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.888001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.888286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.888558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.889188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.889656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:08.890257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:08.890565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:08.890835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:08.891229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.891455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:08.893341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:08.978005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1255/2501] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:08.980625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:08.992659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a86402-7827-49ca-a206-48693f1d8846 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:08.999336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1247/2502] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:08 2022] POST /identity/v3/users => generated 306 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:09.000513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.007470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.008153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.008437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.008708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.009356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.011881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.012007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383e3b-c5cd-485f-9230-84138419eb6c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.016964 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.017589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.017937 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.018362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.019116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.021069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.026245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1256/2503] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:09.029883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:09.032116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.036749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1248/2504] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:09.040347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.047190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e8d82-b463-43aa-99f1-1460e3057a6e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.052535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.053556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.054048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01f77-ff3c-44f5-98fc-8d393b0c5abb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.054645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.055125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.055990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.057801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.059210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.059895 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.060165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.060444 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] PATH_INFO: `/v3/projects/c85ed26261f94b54b2ea048f257654e3/users/e46e496cac1d448bbc5582829b1f6633/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.083885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85ed26261f94b54b2ea048f257654e3, user_id=e46e496cac1d448bbc5582829b1f6633, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.087633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.098977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1257/2505] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:09.100158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.116310 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b0f47-80f5-47e9-b456-ed996d04756e admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.122101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806a24-6600-4c7a-bfc1-8e9780e52237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.122820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806a24-6600-4c7a-bfc1-8e9780e52237 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.123097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806a24-6600-4c7a-bfc1-8e9780e52237 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.123639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806a24-6600-4c7a-bfc1-8e9780e52237 admin admin] PATH_INFO: `/v3/projects/8af87cd85acd453fac7b3b4f386c8789/users/b530505d0762441593993d9f87a3ad78/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.142515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806a24-6600-4c7a-bfc1-8e9780e52237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af87cd85acd453fac7b3b4f386c8789, user_id=b530505d0762441593993d9f87a3ad78, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.144736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806a24-6600-4c7a-bfc1-8e9780e52237 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.169060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1249/2506] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:09 2022] PUT /identity/v3/projects/c85ed26261f94b54b2ea048f257654e3/users/e46e496cac1d448bbc5582829b1f6633/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:09.170579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.220952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1258/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:09 2022] PUT /identity/v3/projects/8af87cd85acd453fac7b3b4f386c8789/users/b530505d0762441593993d9f87a3ad78/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:09.228181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.228479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.228760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.263561 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:09.264801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:09.272327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddcfe6-289d-466b-bfce-a469ee449b53 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.294693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:09.340094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.341162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.341441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.341712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.342420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.344414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.359129 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1259/2508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:09.465433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1250/2509] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:09.469549 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.471581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.473328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:09.488245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a07138-db60-4265-83e5-65ba9cce9506 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.496547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb448e7-ba83-4b3d-b5b7-cdce5c01d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.497341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb448e7-ba83-4b3d-b5b7-cdce5c01d434 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.497685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb448e7-ba83-4b3d-b5b7-cdce5c01d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.498117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb448e7-ba83-4b3d-b5b7-cdce5c01d434 admin admin] PATH_INFO: `/v3/projects/c85ed26261f94b54b2ea048f257654e3/users/e46e496cac1d448bbc5582829b1f6633/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.500287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb448e7-ba83-4b3d-b5b7-cdce5c01d434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85ed26261f94b54b2ea048f257654e3, user_id=e46e496cac1d448bbc5582829b1f6633, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.503529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb448e7-ba83-4b3d-b5b7-cdce5c01d434 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.521426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1260/2510] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:09 2022] PUT /identity/v3/projects/c85ed26261f94b54b2ea048f257654e3/users/e46e496cac1d448bbc5582829b1f6633/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:09.534115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.534316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.534629 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.537830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697cab-025f-4ab8-815c-1fdaf761d5c2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.564108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] MFA Rules not processed for user `e46e496cac1d448bbc5582829b1f6633`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:09.565326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:09.597960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.598629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.598921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.599182 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.661225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1261/2511] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:09.675884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.676127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:09.677355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.677648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:09.687679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1251/2512] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:09.726311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:09.741646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5830fd-8b74-42fe-bb7b-b7c8570fc82c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:09.745277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:09.746677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:09.746954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:09.747220 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:09.757430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:09.780210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:09.780210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1262/2513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:10.387764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:10.397060 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d8915-ac09-4fdb-a689-10d64906a7af service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:10.400647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418413c7-7a24-4e9e-a7bc-348acd504a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:10.401237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418413c7-7a24-4e9e-a7bc-348acd504a51 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:10.401531 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418413c7-7a24-4e9e-a7bc-348acd504a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:10.402388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418413c7-7a24-4e9e-a7bc-348acd504a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:10.428913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=100 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:10.469213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418413c7-7a24-4e9e-a7bc-348acd504a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:10.470707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418413c7-7a24-4e9e-a7bc-348acd504a51 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:10.480589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1252/2514] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:10 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:11.275495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:11.278430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:11.384740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7f164-b222-4106-87c6-b60ddd1b559d service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:11.393849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:11.396209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:11.396508 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:11.396780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:11.400131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:11.421726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:11.421726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:11.431800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1263/2515] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:13.138372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:13.138919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:13.139045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:13.182321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] MFA Rules not processed for user `290af177fc5949098721ca1b909d9ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:13.184176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:13.257989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1253/2516] 10.222.0.27 () {58 vars in 967 bytes} [Wed Sep 14 02:58:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:13.265858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:13.267417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:13.348061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274d9e-95e0-4e39-bea6-8defa260f35e service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:13.353026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9a818-50b6-43a3-afeb-03c85437730a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '476b4c55503a4c01b0ad7882e62f5461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:13.353724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9a818-50b6-43a3-afeb-03c85437730a service swift] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:13.354001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9a818-50b6-43a3-afeb-03c85437730a service swift] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:13.354271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9a818-50b6-43a3-afeb-03c85437730a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:13.363649 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9a818-50b6-43a3-afeb-03c85437730a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:13.365413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9a818-50b6-43a3-afeb-03c85437730a service swift] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:13.375505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1264/2517] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Sep 14 02:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 02:58:16.033781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.053342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cce42-7d9e-4aa2-8f95-1ce687b09e7d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.059083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.059867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.060247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.060750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] PATH_INFO: `/v3/users/9f9a3b9910e84f2db2b4d19e3e7d0168` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.062455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9a3b9910e84f2db2b4d19e3e7d0168)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.064688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.158371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.158920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.159026 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.192225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] MFA Rules not processed for user `b530505d0762441593993d9f87a3ad78`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:16.193668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:16.250190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:16.263746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9a3b9910e84f2db2b4d19e3e7d0168'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:16.268988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9a3b9910e84f2db2b4d19e3e7d0168'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:16.278699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1265/2518] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:16.283336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.297386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf1dd8-7c82-4c2f-bddb-622706be743f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.302604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.303237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.303663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.303943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.304587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.306703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.333051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9a3b9910e84f2db2b4d19e3e7d0168'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:16.333719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9a3b9910e84f2db2b4d19e3e7d0168'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:16.350336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-e9767e09-975e-4e46-8caf-a9eb2033ed97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9a3b9910e84f2db2b4d19e3e7d0168'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:16.365845 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1254/2519] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:16 2022] DELETE /identity/v3/users/9f9a3b9910e84f2db2b4d19e3e7d0168 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:16.370942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.371265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.371751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.392734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:16.394019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:16.414920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1266/2520] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:16.416091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.418308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:16.442325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:16.476491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1255/2521] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:16.487415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.489528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:16.495157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21126289-908f-4e8c-92f5-c20762738a10 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.501230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.501865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.502195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.502416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.503106 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.505024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.571111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55aa92-2872-4728-95a5-89a574321101 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.623610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.624224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.624505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.624776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.625364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1267/2522] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:16 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:16.629356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.634851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.637408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.640877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cf9c9-e4a3-40ef-ab44-4fb39b926a2f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.647076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.647830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.647981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1256/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:16.648123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.648397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.649110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.650791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.663241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1268/2524] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:16.674575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.685076 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a090d-f442-4d00-b308-a9094077c445 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.690281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.690975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.691413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.691648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] PATH_INFO: `/v3/projects/ac2a7b0878d5455e92dbaa1032894143/users/5dd3f860a2984731a26b5cf15b5756b6/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.708836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2a7b0878d5455e92dbaa1032894143, user_id=5dd3f860a2984731a26b5cf15b5756b6, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.711552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.785327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1257/2525] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:16 2022] PUT /identity/v3/projects/ac2a7b0878d5455e92dbaa1032894143/users/5dd3f860a2984731a26b5cf15b5756b6/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:16.789342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.799988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546356a6-4654-41c9-bcfb-73d3a9998095 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.859754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.860435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.860716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.860986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.861626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.863277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.875734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1269/2526] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:16.880252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:16.891388 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb4fe2-1104-4508-b3f7-28dfe19800c0 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:16.896136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:16.896781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:16.897054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:16.897381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] PATH_INFO: `/v3/projects/ac2a7b0878d5455e92dbaa1032894143/users/5dd3f860a2984731a26b5cf15b5756b6/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:16.899345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2a7b0878d5455e92dbaa1032894143, user_id=5dd3f860a2984731a26b5cf15b5756b6, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:16.902009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:16.913015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1258/2527] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:16 2022] PUT /identity/v3/projects/ac2a7b0878d5455e92dbaa1032894143/users/5dd3f860a2984731a26b5cf15b5756b6/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:17.065475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:17.067481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:17.089058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c817-6397-4781-a106-b0d4799d5c8b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:17.133446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:17.159923 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:17.160562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:17.160847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:17.161123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] PATH_INFO: `/v3/projects/4794df72ef1949049dd6e180aab9ca03` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:17.162266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4794df72ef1949049dd6e180aab9ca03)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:17.164193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:17.281796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4794df72ef1949049dd6e180aab9ca03', 'request_id': 'req-063a3ff5-ebed-48d3-8314-e8cc3ad86805'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.288998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4794df72ef1949049dd6e180aab9ca03', 'request_id': 'req-063a3ff5-ebed-48d3-8314-e8cc3ad86805'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.356096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4794df72ef1949049dd6e180aab9ca03', 'request_id': 'req-063a3ff5-ebed-48d3-8314-e8cc3ad86805'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.367732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] The token cache is being invalidate because project 4794df72ef1949049dd6e180aab9ca03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:17.368000 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.368641 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.370134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1270/2528] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:17 2022] DELETE /identity/v3/projects/4794df72ef1949049dd6e180aab9ca03 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:17.374786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:17.376817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:17.390283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be9b09-1567-4229-9abd-f0c9ec287f4e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:17.458175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:17.458854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:17.459133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:17.459406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] PATH_INFO: `/v3/users/e46e496cac1d448bbc5582829b1f6633` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:17.460605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46e496cac1d448bbc5582829b1f6633)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:17.462616 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:17.467663 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:17.698353 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46e496cac1d448bbc5582829b1f6633'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.699587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46e496cac1d448bbc5582829b1f6633'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.783503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46e496cac1d448bbc5582829b1f6633'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.784669 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46e496cac1d448bbc5582829b1f6633'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.802551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a57f6338-d4bb-473f-839f-59e6c93d8c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46e496cac1d448bbc5582829b1f6633'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:17.821198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1259/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:17 2022] DELETE /identity/v3/users/e46e496cac1d448bbc5582829b1f6633 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:18.284137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:18.296456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3ff5-ebed-48d3-8314-e8cc3ad86805 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:18.360294 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:18.361544 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:18.361953 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:18.362304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] PATH_INFO: `/v3/projects/c85ed26261f94b54b2ea048f257654e3` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:18.363805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85ed26261f94b54b2ea048f257654e3)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:18.366127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:18.483664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85ed26261f94b54b2ea048f257654e3', 'request_id': 'req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:18.490015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85ed26261f94b54b2ea048f257654e3', 'request_id': 'req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:18.579216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85ed26261f94b54b2ea048f257654e3', 'request_id': 'req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:18.588411 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:18.594950 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] The token cache is being invalidate because project c85ed26261f94b54b2ea048f257654e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:18.595369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:18.596162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f704bdf0-3ca8-46f8-bf4d-0116d8d3b2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:18.598007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1271/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:18 2022] DELETE /identity/v3/projects/c85ed26261f94b54b2ea048f257654e3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:18.607634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:18.608595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:18.609032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:18.637938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:18.639679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:18.726512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1260/2531] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:18.735053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:18.735248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:18.735656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:18.758131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:18.759432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:18.770046 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1272/2532] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:18.774373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:18.786033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d852bc-33a6-4ee5-ba33-697fffc30c6d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:18.791483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:18.792363 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:18.793773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:18.794652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:18.794957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:18.795351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:18.796990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:18.815926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1261/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:58:18.821321 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:18.834911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae1e2-1408-4488-9e36-64f7e6eeb91b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:18.842190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:18.843696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:18.843825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:18.844065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:18.844715 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:18.846650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:18.939956 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1273/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:18 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:18.944439 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:18.955550 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070475b-5115-4d0e-9283-8b0ef97ca43f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.019077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.019693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.020219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.020905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.021129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.023215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:19.147129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:19.158170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1262/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:18 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:19.159013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:19.170530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad743-0644-407b-ba35-97dca0fc1e3c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.175152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.175880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.176064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.176293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.176928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.181739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:19.193627 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1274/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:19.197539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:19.209573 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b49f74-28f2-47f2-8e1e-8cebbafbe7c4 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.216086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b686-4e16-4af0-a367-c5a1514de56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.216939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b686-4e16-4af0-a367-c5a1514de56d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.217262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b686-4e16-4af0-a367-c5a1514de56d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.217501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b686-4e16-4af0-a367-c5a1514de56d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.218212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978b686-4e16-4af0-a367-c5a1514de56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.219905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978b686-4e16-4af0-a367-c5a1514de56d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:19.235781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1263/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:19.240151 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:19.250266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef4ad5-7495-44d9-9949-8a7d4df2a15a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.255273 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.256105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.256386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.256868 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] PATH_INFO: `/v3/projects/a42f681fef3c4347accd2bcf30a59615/users/d43ae6c2764a49308042a8f929944279/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.274661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42f681fef3c4347accd2bcf30a59615, user_id=d43ae6c2764a49308042a8f929944279, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.278042 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:19.350611 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1275/2538] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:19 2022] PUT /identity/v3/projects/a42f681fef3c4347accd2bcf30a59615/users/d43ae6c2764a49308042a8f929944279/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:19.363815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.364106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.364387 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.396377 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] MFA Rules not processed for user `d43ae6c2764a49308042a8f929944279`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:19.397611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:19.476504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1264/2539] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:19.481246 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:19.563689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f92d6b-2680-47bf-ad0e-2f3a03fb58ab admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.569909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.570873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.571162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.571553 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.573593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.575602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:19.689907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1276/2540] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:19 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:19.691488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:19.703874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d746ef-1b23-4d5a-9e54-86c5ba853cbd None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.791514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.792301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.797237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.797237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.797237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.797237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:19.931524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1265/2541] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:19 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:19.936255 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:19.951941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf852de-2229-4426-89a9-38bbe87bbae3 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:19.973281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:19.975185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:19.975672 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:19.976138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:19.977015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:19.979128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:20.013910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1277/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:20.018364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:20.045341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9c8a-c0ad-4fbc-a02f-45964223569b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:20.056776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:20.057477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:20.057741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:20.058735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] PATH_INFO: `/v3/projects/976e0d70cd6c4be28024ec7873e6c7f0/users/540b0f7903ab4323a9190737727a29b8/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:20.098021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976e0d70cd6c4be28024ec7873e6c7f0, user_id=540b0f7903ab4323a9190737727a29b8, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:20.100785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:20.218791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1266/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:20 2022] PUT /identity/v3/projects/976e0d70cd6c4be28024ec7873e6c7f0/users/540b0f7903ab4323a9190737727a29b8/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:20.220496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:20.240770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d157b-a7c1-41ff-af94-9a5d4ed5b150 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:20.377853 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd575969-f23e-4742-8039-d34c983f9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:20.378901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd575969-f23e-4742-8039-d34c983f9e11 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:20.378901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd575969-f23e-4742-8039-d34c983f9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:20.379251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd575969-f23e-4742-8039-d34c983f9e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:20.381476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd575969-f23e-4742-8039-d34c983f9e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:20.384671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd575969-f23e-4742-8039-d34c983f9e11 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:20.406625 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1278/2544] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:20.410497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:20.424150 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a82f50-ef4d-45ea-8e88-38d8e492cdd3 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:20.430442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:20.431503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:20.432039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:20.432643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] PATH_INFO: `/v3/projects/976e0d70cd6c4be28024ec7873e6c7f0/users/540b0f7903ab4323a9190737727a29b8/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:20.435563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=976e0d70cd6c4be28024ec7873e6c7f0, user_id=540b0f7903ab4323a9190737727a29b8, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:20.442031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:20.458520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1267/2545] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:20 2022] PUT /identity/v3/projects/976e0d70cd6c4be28024ec7873e6c7f0/users/540b0f7903ab4323a9190737727a29b8/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:20.469831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:20.470378 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:20.470841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:20.492846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:20.519343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] MFA Rules not processed for user `540b0f7903ab4323a9190737727a29b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:20.520667 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:20.600766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1279/2546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:20.612268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:20.613982 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:20.661587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:20.693279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948220cd-fd05-4571-a1b8-24e97fec35fa admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:20.699420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059a7b-4f1a-4ead-8922-aa4c9fb68b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:20.700760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059a7b-4f1a-4ead-8922-aa4c9fb68b4a service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:20.701047 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059a7b-4f1a-4ead-8922-aa4c9fb68b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:20.701326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059a7b-4f1a-4ead-8922-aa4c9fb68b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:20.711621 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7059a7b-4f1a-4ead-8922-aa4c9fb68b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:20.713606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7059a7b-4f1a-4ead-8922-aa4c9fb68b4a service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:20.725389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1268/2547] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:20.851017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:20.867904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c63f3-adb0-4d7b-b925-a10fc5844910 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:20.872624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:20.873062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:20.873345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:20.873626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:20.965874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:20.968162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:20.994802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1280/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:23.288453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:23.288929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:23.289028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:23.323211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] MFA Rules not processed for user `5dd3f860a2984731a26b5cf15b5756b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:23.325425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:23.406769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1269/2549] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:23.424414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:23.425977 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:23.509146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86fa2c-e645-43d7-8a1f-dccbd233260a service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:23.516055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:23.516753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:23.517036 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:23.517344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:23.519170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:23.549802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:23.585186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:23.586802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a019ff-9064-477c-8642-46de810eee07 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:23.596370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1281/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:24.589191 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:24.747565 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdc174-c516-4795-be47-9a196dd1f5dd None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:24.753400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:24.754595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:24.755032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:24.755509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] PATH_INFO: `/v3/users/d43ae6c2764a49308042a8f929944279` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:24.756884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43ae6c2764a49308042a8f929944279)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:24.759095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:24.785265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:24.959042 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43ae6c2764a49308042a8f929944279'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:24.959792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43ae6c2764a49308042a8f929944279'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:25.030156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43ae6c2764a49308042a8f929944279'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:25.030944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43ae6c2764a49308042a8f929944279'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:25.053651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43ae6c2764a49308042a8f929944279'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:25.073463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1270/2551] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:24 2022] DELETE /identity/v3/users/d43ae6c2764a49308042a8f929944279 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:25.078696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:25.079584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:25.080040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:25.154157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:25.155566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:25.218979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1282/2552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:25.226302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:25.227816 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:25.307782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa3431-4481-4154-b60f-77f10f60cf8c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:25.311404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:25.312099 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:25.316737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:25.316737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:25.323097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:25.324932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:25.336881 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1271/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:25.826047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:25.830118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:25.847888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c73ed-2991-4f24-a66f-dea408a037da None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:25.855369 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:25.856739 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:25.857437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:25.857817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] PATH_INFO: `/v3/projects/a42f681fef3c4347accd2bcf30a59615` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:25.860670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42f681fef3c4347accd2bcf30a59615)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:25.862907 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:25.974772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42f681fef3c4347accd2bcf30a59615', 'request_id': 'req-eb2bd85d-9df6-49f6-b77c-7be0600daabb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:25.981646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42f681fef3c4347accd2bcf30a59615', 'request_id': 'req-eb2bd85d-9df6-49f6-b77c-7be0600daabb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.063624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42f681fef3c4347accd2bcf30a59615', 'request_id': 'req-eb2bd85d-9df6-49f6-b77c-7be0600daabb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.077052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] The token cache is being invalidate because project a42f681fef3c4347accd2bcf30a59615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:26.077524 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.078207 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-eb2bd85d-9df6-49f6-b77c-7be0600daabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.079838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1283/2554] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:25 2022] DELETE /identity/v3/projects/a42f681fef3c4347accd2bcf30a59615 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:26.087820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:26.103570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e5791-d37e-4f61-a2f0-14c6ac106b4c service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:26.181163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:26.182054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:26.182403 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:26.182867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] PATH_INFO: `/v3/users/540b0f7903ab4323a9190737727a29b8` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:26.184832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=540b0f7903ab4323a9190737727a29b8)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:26.187160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:26.299454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:26.389004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540b0f7903ab4323a9190737727a29b8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.391952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540b0f7903ab4323a9190737727a29b8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.449160 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa6692-05a0-42b6-b0b8-992cf6d2986d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:26.449469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa6692-05a0-42b6-b0b8-992cf6d2986d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:26.450024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa6692-05a0-42b6-b0b8-992cf6d2986d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:26.471031 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b0fa6692-05a0-42b6-b0b8-992cf6d2986d None None] MFA Rules not processed for user `b530505d0762441593993d9f87a3ad78`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:26.472285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0fa6692-05a0-42b6-b0b8-992cf6d2986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:26.495034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540b0f7903ab4323a9190737727a29b8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.497064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540b0f7903ab4323a9190737727a29b8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.503613 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:26.513294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540b0f7903ab4323a9190737727a29b8'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:26.536755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1272/2555] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:26 2022] DELETE /identity/v3/users/540b0f7903ab4323a9190737727a29b8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:26.566770 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1284/2556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:27.122618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:27.122618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:27.204524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138dd60-5641-4023-a138-a86037d5d7fa admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:27.209888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:27.210769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:27.211211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:27.211653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] PATH_INFO: `/v3/projects/976e0d70cd6c4be28024ec7873e6c7f0` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:27.212810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976e0d70cd6c4be28024ec7873e6c7f0)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:27.214860 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:27.336652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976e0d70cd6c4be28024ec7873e6c7f0', 'request_id': 'req-50cb5454-b587-4793-a053-44b653779b71'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:27.343281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976e0d70cd6c4be28024ec7873e6c7f0', 'request_id': 'req-50cb5454-b587-4793-a053-44b653779b71'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:27.450196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976e0d70cd6c4be28024ec7873e6c7f0', 'request_id': 'req-50cb5454-b587-4793-a053-44b653779b71'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:27.464831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] The token cache is being invalidate because project 976e0d70cd6c4be28024ec7873e6c7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:27.465652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:27.466210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-50cb5454-b587-4793-a053-44b653779b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:27.468252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1273/2557] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:27 2022] DELETE /identity/v3/projects/976e0d70cd6c4be28024ec7873e6c7f0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:27.473020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:27.473502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:27.474498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:27.524483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:27.525801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:27.589647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1285/2558] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:27.597989 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:27.601004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:27.601004 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:27.618944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:27.620183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:27.628544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1274/2559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:27.632673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:27.643601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d85d-3766-4330-8fb8-e64c83fb5ecf None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:27.648681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:27.649330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:27.649610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:27.649931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:27.650612 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:27.650918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:27.653024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:27.665318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1286/2560] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:58:27.671844 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:27.681555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119789d0-7b45-43c0-a041-21acb5e29629 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:27.687109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:27.689175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:27.689175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:27.689175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:27.689175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:27.690815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:27.716869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:27.829836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1275/2561] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:27 2022] POST /identity/v3/projects => generated 407 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:27.834910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:27.853244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf3647-007b-479e-ac31-11d9cd5c21c9 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:27.920483 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:27.921414 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:27.921888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:27.922529 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:27.923340 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:27.925546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.022724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1287/2562] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:27 2022] POST /identity/v3/users => generated 304 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:28.029346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.039944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6b7a-41fb-412f-9a69-d64b17b9203d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.046222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.046946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.047384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.047697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.048645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.050491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.063676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1276/2563] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:28.067043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.077426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8759ed4-5e4a-4830-a193-025f57ba2f80 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.082216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf0f05-42f1-471c-b8fa-2f8bd2f695c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.082855 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0f05-42f1-471c-b8fa-2f8bd2f695c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.083135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0f05-42f1-471c-b8fa-2f8bd2f695c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.083408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0f05-42f1-471c-b8fa-2f8bd2f695c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.084064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf0f05-42f1-471c-b8fa-2f8bd2f695c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.085663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf0f05-42f1-471c-b8fa-2f8bd2f695c3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.102986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1288/2564] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:28.108016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.118316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6a29-1a5a-428f-a9c7-4173d393c03d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.123926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.124602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.124992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.125112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] PATH_INFO: `/v3/projects/7d526e0d2acf43c7aa8028c51b8a6d4e/users/93f87799a2964dd099ee57b0dff25004/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.145846 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d526e0d2acf43c7aa8028c51b8a6d4e, user_id=93f87799a2964dd099ee57b0dff25004, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.151103 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.247931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1277/2565] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:28 2022] PUT /identity/v3/projects/7d526e0d2acf43c7aa8028c51b8a6d4e/users/93f87799a2964dd099ee57b0dff25004/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:28.258285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.258604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.258880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.285092 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:28.296199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] MFA Rules not processed for user `93f87799a2964dd099ee57b0dff25004`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:28.297429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:28.363795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1289/2566] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:28 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:28.368314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.436131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8c7f4-a123-49f6-a89b-f3f2d81efc67 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.440848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.441447 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.441723 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.441995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.442664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.444773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.566644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1278/2567] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:28 2022] POST /identity/v3/projects => generated 407 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:28.570578 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.584388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dbe41-ce4c-447f-ae8d-24a5cb466332 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.648687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.649302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.649583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.649851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.650511 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.652514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.759192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1290/2568] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:28 2022] POST /identity/v3/users => generated 310 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:28.760592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.771793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fcfdc-8575-4cf7-b299-56612b0a45a2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.776034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.776629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.776905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.777235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.777817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.779454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.795246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1279/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:28.796485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.807204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295e02e-851b-46a9-bd70-5ed005124549 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.812726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.813380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.813656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.813926 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] PATH_INFO: `/v3/projects/7b9897cca2e946f9918fdecf5567308f/users/43108cc58b5b47a093ed8f06904c39b5/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.831225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9897cca2e946f9918fdecf5567308f, user_id=43108cc58b5b47a093ed8f06904c39b5, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.833924 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.901646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1291/2570] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:28 2022] PUT /identity/v3/projects/7b9897cca2e946f9918fdecf5567308f/users/43108cc58b5b47a093ed8f06904c39b5/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:28.906520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:28.916677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143739b0-5d28-4509-85a8-2603398f8e3e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:28.979344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76ebc-0f66-4036-8be7-3dbbd8115f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:28.979968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76ebc-0f66-4036-8be7-3dbbd8115f43 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:28.980270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76ebc-0f66-4036-8be7-3dbbd8115f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:28.980541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76ebc-0f66-4036-8be7-3dbbd8115f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:28.981421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76ebc-0f66-4036-8be7-3dbbd8115f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:28.983067 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76ebc-0f66-4036-8be7-3dbbd8115f43 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:28.993438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1280/2571] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:28.998671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:29.009698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743971f6-b7d5-40a0-8bc5-761d00d3ec84 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:29.015565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:29.016330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:29.016676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:29.017020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] PATH_INFO: `/v3/projects/7b9897cca2e946f9918fdecf5567308f/users/43108cc58b5b47a093ed8f06904c39b5/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:29.019440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9897cca2e946f9918fdecf5567308f, user_id=43108cc58b5b47a093ed8f06904c39b5, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:29.022091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:29.034146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1292/2572] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:28 2022] PUT /identity/v3/projects/7b9897cca2e946f9918fdecf5567308f/users/43108cc58b5b47a093ed8f06904c39b5/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:29.046290 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:29.046682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:29.047017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:29.083246 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] MFA Rules not processed for user `43108cc58b5b47a093ed8f06904c39b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:29.085276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:29.105637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:29.190114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1281/2573] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:29 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:29.192078 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:29.193851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:29.281091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:29.309384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d53261-d600-4073-80f3-6c7421f17949 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:29.313187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:29.313797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:29.314070 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:29.314338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:29.329937 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:29.331630 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:29.343259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1293/2574] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:29 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:29.771278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:29.786181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e6777-881f-46d8-a99e-c58e3f31b107 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:29.791390 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:29.792366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:29.793134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:29.793712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:29.873473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:29.880001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:29.890984 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1282/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:36.485673 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:36.488720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:36.573618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce55705-98cb-4bc8-a17e-a63e1cac1fda service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:36.578152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:36.578794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:36.579076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:36.579374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:36.581183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:36.650001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:36.651398 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d98617-7103-4774-80d3-d3e2dae124d7 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:36.661323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1294/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:36.750722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:36.761209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68772-852c-4f23-9b1b-173750e0183e service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:36.766733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:36.767367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:36.767647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:36.767923 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] PATH_INFO: `/v3/users/93f87799a2964dd099ee57b0dff25004` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:36.769084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f87799a2964dd099ee57b0dff25004)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:36.771043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:36.948344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f87799a2964dd099ee57b0dff25004'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:36.949193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f87799a2964dd099ee57b0dff25004'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.018431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f87799a2964dd099ee57b0dff25004'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.022386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f87799a2964dd099ee57b0dff25004'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.033473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f87799a2964dd099ee57b0dff25004'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.065294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1283/2577] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:36 2022] DELETE /identity/v3/users/93f87799a2964dd099ee57b0dff25004 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:37.069850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:37.074034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:37.074034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:37.098931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:37.100202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:37.166399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1295/2578] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:37.176350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:37.177919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:37.213229 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:37.240277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a13d0-0a06-4351-852b-9296de3cefdd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:37.244053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:37.244804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:37.245084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:37.245356 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:37.260704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:37.265075 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:37.272518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1284/2579] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:37.683948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:37.685185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:37.698664 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:37.715325 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60fece-d8bd-40d7-bc09-d1e3a9bb2d15 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:37.722930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:37.723751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:37.724278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:37.724557 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] PATH_INFO: `/v3/projects/7d526e0d2acf43c7aa8028c51b8a6d4e` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:37.726665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d526e0d2acf43c7aa8028c51b8a6d4e)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:37.729275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:37.868987 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d526e0d2acf43c7aa8028c51b8a6d4e', 'request_id': 'req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.876810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d526e0d2acf43c7aa8028c51b8a6d4e', 'request_id': 'req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.938123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d526e0d2acf43c7aa8028c51b8a6d4e', 'request_id': 'req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.949213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] The token cache is being invalidate because project 7d526e0d2acf43c7aa8028c51b8a6d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:37.949506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.950164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:37.952300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1296/2580] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:37 2022] DELETE /identity/v3/projects/7d526e0d2acf43c7aa8028c51b8a6d4e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:37.956534 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:37.968370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4e902-6934-4ece-981f-78699b167dd9 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:38.028586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:38.029393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:38.029674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:38.029947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] PATH_INFO: `/v3/users/43108cc58b5b47a093ed8f06904c39b5` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:38.031154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43108cc58b5b47a093ed8f06904c39b5)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:38.033087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:38.235154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43108cc58b5b47a093ed8f06904c39b5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:38.235824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43108cc58b5b47a093ed8f06904c39b5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:38.309176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43108cc58b5b47a093ed8f06904c39b5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:38.310817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43108cc58b5b47a093ed8f06904c39b5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:38.326760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-83c0804c-1e17-43ac-9a18-00fc9c867b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43108cc58b5b47a093ed8f06904c39b5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:38.344320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1285/2581] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:37 2022] DELETE /identity/v3/users/43108cc58b5b47a093ed8f06904c39b5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:38.820550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:38.822591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:38.838014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e968a5e-f1c4-4645-895d-f5a7de01a4c7 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:38.904541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:38.905279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:38.905690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:38.906227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] PATH_INFO: `/v3/projects/7b9897cca2e946f9918fdecf5567308f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:38.907966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9897cca2e946f9918fdecf5567308f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:38.910380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.042489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9897cca2e946f9918fdecf5567308f', 'request_id': 'req-bb2f3543-5f52-429c-8779-6ab95c253e42'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:39.049737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9897cca2e946f9918fdecf5567308f', 'request_id': 'req-bb2f3543-5f52-429c-8779-6ab95c253e42'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:39.108774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9897cca2e946f9918fdecf5567308f', 'request_id': 'req-bb2f3543-5f52-429c-8779-6ab95c253e42'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:39.120463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] The token cache is being invalidate because project 7b9897cca2e946f9918fdecf5567308f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:39.120752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:39.121415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-bb2f3543-5f52-429c-8779-6ab95c253e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:39.123576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1297/2582] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:38 2022] DELETE /identity/v3/projects/7b9897cca2e946f9918fdecf5567308f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:39.128745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.129251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.129750 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.151148 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:39.152454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:39.204749 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:39.220158 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1286/2583] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:39.229726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.229955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.230230 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.251723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:39.253072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:39.266141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1298/2584] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:39.267699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:39.279414 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354da-fa88-4c90-bb66-03f4854be339 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:39.285192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:39.285946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.286322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.286765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.287539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:39.287946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:39.289699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.305894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1287/2585] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:58:39.311389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:39.323934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f9af-7d59-4ec0-8173-c746baf33733 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:39.328913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:39.329541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.329825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.330100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.330778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:39.332740 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.347130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:39.438602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1299/2586] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:39 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:39.442646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:39.453991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696f73d-9861-4a03-8934-8b4bf26c4b17 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:39.522163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:39.522865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.523213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.523665 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.524426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:39.526649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.652596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1288/2587] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:39 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:39.656722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:39.667476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fb9b5-4030-44de-a481-6e2d5563d1d5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:39.672832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:39.673437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.673792 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.674025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.674705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:39.676302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.687610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1300/2588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:39.691644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:39.702622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd42d7-fadf-42fa-b43d-a5c2a97ada02 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:39.707392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696167e-39f8-4726-8088-6226f4eb46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:39.708001 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696167e-39f8-4726-8088-6226f4eb46ca admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.708283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696167e-39f8-4726-8088-6226f4eb46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.708560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696167e-39f8-4726-8088-6226f4eb46ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.709207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696167e-39f8-4726-8088-6226f4eb46ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:39.710856 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696167e-39f8-4726-8088-6226f4eb46ca admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.722126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1289/2589] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:39.726571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:39.736571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee77043-0e7a-4e09-bedd-ff03aaecf5ee admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:39.741091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:39.746279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.746279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.746279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] PATH_INFO: `/v3/projects/bfbbcc1ca815426aa6251f917ac1c168/users/6751c8428ccb42a3a4d8dc3d6736c0be/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.757668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbbcc1ca815426aa6251f917ac1c168, user_id=6751c8428ccb42a3a4d8dc3d6736c0be, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:39.760198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:39.853281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1301/2590] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:39 2022] PUT /identity/v3/projects/bfbbcc1ca815426aa6251f917ac1c168/users/6751c8428ccb42a3a4d8dc3d6736c0be/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:39.865907 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:39.866350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:39.866794 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:39.899328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] MFA Rules not processed for user `6751c8428ccb42a3a4d8dc3d6736c0be`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:39.900830 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:40.009263 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1290/2591] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:40.031922 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:40.033877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:40.140496 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed38c05-e598-4aff-92a9-a0507afc421d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:40.144487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1c4e5-76fe-4296-bc79-8e36fb435526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:40.145114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c4e5-76fe-4296-bc79-8e36fb435526 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:40.145395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c4e5-76fe-4296-bc79-8e36fb435526 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:40.145669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1c4e5-76fe-4296-bc79-8e36fb435526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:40.160763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1c4e5-76fe-4296-bc79-8e36fb435526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:40.165368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1c4e5-76fe-4296-bc79-8e36fb435526 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:40.172441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1302/2592] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:40.197959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:40.252822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:40.270453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f6650-2d79-4bbb-8679-727b00c7ebf5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:40.275385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:40.275944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:40.276218 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:40.276485 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] PATH_INFO: `/v3/users/6751c8428ccb42a3a4d8dc3d6736c0be` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:40.277642 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6751c8428ccb42a3a4d8dc3d6736c0be)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:40.280453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:40.475352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6751c8428ccb42a3a4d8dc3d6736c0be'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:40.476135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6751c8428ccb42a3a4d8dc3d6736c0be'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:40.572701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6751c8428ccb42a3a4d8dc3d6736c0be'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:40.573316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6751c8428ccb42a3a4d8dc3d6736c0be'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:40.586419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6751c8428ccb42a3a4d8dc3d6736c0be'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:40.599668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1291/2593] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:40 2022] DELETE /identity/v3/users/6751c8428ccb42a3a4d8dc3d6736c0be => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:40.604218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:40.604507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:40.604779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:40.627261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:40.628952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:40.634686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:40.636212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:40.701952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79d85e-db08-4165-bffa-797b18e8bcdc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:40.705839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1303/2594] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:40.706818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:40.707449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:40.707731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:40.708083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] PATH_INFO: `/v3/users/a4cd49cba5ac42a999f95733cc3a466c` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:40.709259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cd49cba5ac42a999f95733cc3a466c)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:40.711224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:40.715472 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:40.716949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:40.773925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2b36-5e7b-4a2b-9689-d3f24397e34a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:40.777558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:40.778165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:40.778486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:40.778811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:40.787874 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:40.789479 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:40.795300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:40.800058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1304/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:40.930219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cd49cba5ac42a999f95733cc3a466c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:40.930880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cd49cba5ac42a999f95733cc3a466c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.006873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cd49cba5ac42a999f95733cc3a466c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.007698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cd49cba5ac42a999f95733cc3a466c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.017639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:41.022433 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cd49cba5ac42a999f95733cc3a466c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.037509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1292/2596] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:40 2022] DELETE /identity/v3/users/a4cd49cba5ac42a999f95733cc3a466c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:41.289503 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.291100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:41.308371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0410875-44d5-4723-a50a-157c75f8370a service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.335754 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.337385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:41.371226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.372177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.372696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.373035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] PATH_INFO: `/v3/projects/bfbbcc1ca815426aa6251f917ac1c168` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.374212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbbcc1ca815426aa6251f917ac1c168)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.376159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.423516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de7c49-fd4f-4d6a-b3bf-6e40f5ed3aa1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.428285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.428914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.429193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.429464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] PATH_INFO: `/v3/projects/b0bcf113f85a41ecada488b2b06c2fa1` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.430625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0bcf113f85a41ecada488b2b06c2fa1)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.432571 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.482930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbbcc1ca815426aa6251f917ac1c168', 'request_id': 'req-e76610b1-b799-4052-8bc1-a58633de9ca1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.489170 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbbcc1ca815426aa6251f917ac1c168', 'request_id': 'req-e76610b1-b799-4052-8bc1-a58633de9ca1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.556092 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0bcf113f85a41ecada488b2b06c2fa1', 'request_id': 'req-aee6e3e8-3b3b-409d-a975-41b238e7fd43'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.562595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0bcf113f85a41ecada488b2b06c2fa1', 'request_id': 'req-aee6e3e8-3b3b-409d-a975-41b238e7fd43'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.572567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbbcc1ca815426aa6251f917ac1c168', 'request_id': 'req-e76610b1-b799-4052-8bc1-a58633de9ca1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.584309 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] The token cache is being invalidate because project bfbbcc1ca815426aa6251f917ac1c168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:41.584604 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.585241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e76610b1-b799-4052-8bc1-a58633de9ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.586775 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1305/2597] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:41 2022] DELETE /identity/v3/projects/bfbbcc1ca815426aa6251f917ac1c168 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:41.592105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3143c-32c9-4dc9-b503-a1dfea34c811 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.592417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3143c-32c9-4dc9-b503-a1dfea34c811 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.592710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3143c-32c9-4dc9-b503-a1dfea34c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.612688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b1a3143c-32c9-4dc9-b503-a1dfea34c811 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:41.613894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b1a3143c-32c9-4dc9-b503-a1dfea34c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:41.652312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0bcf113f85a41ecada488b2b06c2fa1', 'request_id': 'req-aee6e3e8-3b3b-409d-a975-41b238e7fd43'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.667140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] The token cache is being invalidate because project b0bcf113f85a41ecada488b2b06c2fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:41.671627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.671627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-aee6e3e8-3b3b-409d-a975-41b238e7fd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:41.671627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1293/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:41 2022] DELETE /identity/v3/projects/b0bcf113f85a41ecada488b2b06c2fa1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:41.675039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e89ca-811c-41a7-a726-ccc36fb46f4c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.675342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e89ca-811c-41a7-a726-ccc36fb46f4c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.675689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e89ca-811c-41a7-a726-ccc36fb46f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.676263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1306/2599] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:41.683712 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.684174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.684461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.696371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e77e89ca-811c-41a7-a726-ccc36fb46f4c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:41.697597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e77e89ca-811c-41a7-a726-ccc36fb46f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:41.705520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:41.706721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:41.706853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1294/2600] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:41.714902 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1307/2601] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:41.715061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.715330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.715674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.718684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.727859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c042-9826-486b-bc34-432a49e5375d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.732478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.733064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.733397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.733843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.734763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:41.735043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.735797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:41.736624 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.737159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:41.745588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1295/2602] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:41.752595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1308/2603] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 02:58:41.752722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.753568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.760458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4730-af2d-40d3-b60a-4daddb270a67 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.763731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfdef5-abe1-40cf-b368-82e0f8e303f4 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.765876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.766499 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.766784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.767059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.767698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:41.768007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.769460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.769596 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.770051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.770332 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.770642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.771272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.773144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.781761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1296/2604] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:58:41.783617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:41.786139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.796267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383cf2-8182-46da-b61d-89f178af94bc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.801144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.801797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.802620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.802620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.803014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.804948 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.837521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1309/2605] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:41.841520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.878853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1297/2606] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:58:41.879863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:41.912140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:41.916854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad0a15-409b-4508-88aa-1b82621161cb admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.949420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1655d-4afb-42b6-8d4e-915c9eea603b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:41.956745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.957350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.960176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.960176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.960176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.961389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:41.974314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:41.974960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:41.975241 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:41.975515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:41.976147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:41.978061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.052427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1298/2607] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:42.056559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.066647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058998ba-4404-467e-a150-85d5bd876089 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.071240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.071817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.072097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.072371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.073017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.075464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.085373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1310/2608] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:41 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:42.086050 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1299/2609] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:58:42.091665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.091813 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.102200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058a24-c607-4361-b6bc-044b5b8d89ce admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.102689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e32f9-556c-4940-b786-28242189c845 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.106995 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.107429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.107620 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.107891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.108040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.108212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.108862 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.109137 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.109797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.109900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.111430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.111551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.121883 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1311/2610] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:42.123442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1300/2611] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:42.126542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.127977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.137034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958101af-a4a9-4d62-8389-d4c2b01e0457 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.137415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2841d69-08b0-43c0-b0be-acfe04c14b2b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.142117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010591-a837-4039-a9ff-33b7a5093d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.142284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.142752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.143002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010591-a837-4039-a9ff-33b7a5093d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.143117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010591-a837-4039-a9ff-33b7a5093d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.143218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.143317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010591-a837-4039-a9ff-33b7a5093d8a admin admin] PATH_INFO: `/v3/projects/c96eb3ac63a347cdb9d6242b5638b0bc/users/37d38ce78cc3456ead41297bbc7a8cc2/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.143410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.143927 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.145783 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.158095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1312/2612] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:42.160458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010591-a837-4039-a9ff-33b7a5093d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96eb3ac63a347cdb9d6242b5638b0bc, user_id=37d38ce78cc3456ead41297bbc7a8cc2, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.161951 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.163525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010591-a837-4039-a9ff-33b7a5093d8a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.172173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ab29a-09b0-49ab-af96-0e1b7a98b178 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.176825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0d97d-2a46-4e59-a517-3b140ba1a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.177449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0d97d-2a46-4e59-a517-3b140ba1a892 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.181164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0d97d-2a46-4e59-a517-3b140ba1a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.181164 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0d97d-2a46-4e59-a517-3b140ba1a892 admin admin] PATH_INFO: `/v3/projects/230703dc98a84e219cf9d2b6f9eaaf26/users/ce1e499c3ad34b24916e8c2a9403c50b/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.192850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0d97d-2a46-4e59-a517-3b140ba1a892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230703dc98a84e219cf9d2b6f9eaaf26, user_id=ce1e499c3ad34b24916e8c2a9403c50b, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.195490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0d97d-2a46-4e59-a517-3b140ba1a892 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.228717 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1301/2613] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:42 2022] PUT /identity/v3/projects/c96eb3ac63a347cdb9d6242b5638b0bc/users/37d38ce78cc3456ead41297bbc7a8cc2/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:42.239618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.239902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.240175 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.253597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1313/2614] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:42 2022] PUT /identity/v3/projects/230703dc98a84e219cf9d2b6f9eaaf26/users/ce1e499c3ad34b24916e8c2a9403c50b/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:42.265819 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.266110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.266387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.268124 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] MFA Rules not processed for user `37d38ce78cc3456ead41297bbc7a8cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:42.269391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:42.294802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] MFA Rules not processed for user `ce1e499c3ad34b24916e8c2a9403c50b`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:42.296525 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:42.331985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:42.342354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1302/2615] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:42.344818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.377284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1314/2616] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:42.390202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.392351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:42.414876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:42.420184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58b2b-8687-4020-bf7a-768b70e46d1c None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.426017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.426944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.427222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.427489 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.428347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.430101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.459698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936d046-c3c0-4c44-9169-7272d4892be2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.463416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.464023 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.464303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.464575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.473245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.474687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.483413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1315/2617] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:42.506692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1303/2618] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:42 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:42.510986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.523318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0972b5-f239-4338-af37-987cc6cac13c service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.583118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.583909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.584269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.584547 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.585382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.587593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.681559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1316/2619] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:42 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:42.685557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.696307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d244-afb0-4f7e-9e76-dab946e0571d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.700931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.701525 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.701806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.702366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.702891 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.704488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.714811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1304/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:42.723208 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.734245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa916-ed27-4f54-afce-2c5bd05731fd admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.738820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.739464 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.739817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.740097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] PATH_INFO: `/v3/projects/b6c6768a4f664234bc7e8121bdc2f3b0/users/ca663e0a27d848d89b49fdac14504769/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.754848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c6768a4f664234bc7e8121bdc2f3b0, user_id=ca663e0a27d848d89b49fdac14504769, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.757475 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.826845 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1317/2621] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:42 2022] PUT /identity/v3/projects/b6c6768a4f664234bc7e8121bdc2f3b0/users/ca663e0a27d848d89b49fdac14504769/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:42.828547 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.838960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ca822-8cb7-422a-bcc6-e836a7e16c7f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.895442 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592857-7950-4e1a-97f2-277760b6d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.896041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592857-7950-4e1a-97f2-277760b6d916 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.896318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592857-7950-4e1a-97f2-277760b6d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.896586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592857-7950-4e1a-97f2-277760b6d916 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.897384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592857-7950-4e1a-97f2-277760b6d916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.899250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592857-7950-4e1a-97f2-277760b6d916 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.909934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1305/2622] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:42.914358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:42.925556 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd59525-adea-466c-9b59-2e4336aa8877 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:42.930538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:42.931234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.931517 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.931788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] PATH_INFO: `/v3/projects/b6c6768a4f664234bc7e8121bdc2f3b0/users/ca663e0a27d848d89b49fdac14504769/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.933726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c6768a4f664234bc7e8121bdc2f3b0, user_id=ca663e0a27d848d89b49fdac14504769, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:42.936387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:42.947275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1318/2623] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:42 2022] PUT /identity/v3/projects/b6c6768a4f664234bc7e8121bdc2f3b0/users/ca663e0a27d848d89b49fdac14504769/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:42.959932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:42.960217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:42.960517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:42.988896 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] MFA Rules not processed for user `ca663e0a27d848d89b49fdac14504769`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:42.990030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:43.058134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1306/2624] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:43.069481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:43.071192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:43.101316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:43.135174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1e31-36b5-41d0-8679-f6c114d00c46 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:43.139180 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:43.140745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:43.141268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:43.141560 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:43.151336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:43.152818 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:43.163167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1319/2625] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:43.387920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:43.401131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973c8c-5a10-40e4-a0a9-c848b90eeba4 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:43.404188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:43.404812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:43.405183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:43.405464 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:43.462988 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:43.473217 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:43.473555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:43.485033 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1307/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:43.739933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:43.741484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:43.799313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e149e7-e25e-4529-8235-036c36254f98 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:43.802884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:43.803482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:43.803761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:43.804032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:43.805833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:43.817304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:43.818889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a545-b772-408a-8a54-08d9ad29059b service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:43.828430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1320/2627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:46.515910 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:46.583736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d2abd-6f78-45dc-8d32-77b05e0d33c4 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:46.588351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:46.588974 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:46.589247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:46.589517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] PATH_INFO: `/v3/users/ce1e499c3ad34b24916e8c2a9403c50b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:46.590691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1e499c3ad34b24916e8c2a9403c50b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:46.592633 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:46.757154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1e499c3ad34b24916e8c2a9403c50b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:46.758193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1e499c3ad34b24916e8c2a9403c50b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:46.829008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1e499c3ad34b24916e8c2a9403c50b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:46.829637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1e499c3ad34b24916e8c2a9403c50b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:46.843418 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1e499c3ad34b24916e8c2a9403c50b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:46.855552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1308/2628] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:46 2022] DELETE /identity/v3/users/ce1e499c3ad34b24916e8c2a9403c50b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:46.860949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:46.861417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:46.861513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:46.881743 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:46.882996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:46.943120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1321/2629] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:46.955936 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:46.957318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:47.035593 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83a11-3848-430c-ae66-6b75d7526548 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:47.039265 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:47.039880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:47.040658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:47.040934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:47.052568 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:47.054022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:47.064906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1309/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:47.419983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:47.421628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:47.435158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3170a-d954-4b06-af62-de5bef31c352 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:47.443410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:47.448952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:47.448952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:47.448952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] PATH_INFO: `/v3/projects/230703dc98a84e219cf9d2b6f9eaaf26` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:47.448952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230703dc98a84e219cf9d2b6f9eaaf26)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:47.448952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:47.649050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230703dc98a84e219cf9d2b6f9eaaf26', 'request_id': 'req-8e0d6a89-1683-4761-9bf1-659e10316336'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:47.657854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230703dc98a84e219cf9d2b6f9eaaf26', 'request_id': 'req-8e0d6a89-1683-4761-9bf1-659e10316336'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:47.767068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230703dc98a84e219cf9d2b6f9eaaf26', 'request_id': 'req-8e0d6a89-1683-4761-9bf1-659e10316336'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:47.771685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:47.778696 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] The token cache is being invalidate because project 230703dc98a84e219cf9d2b6f9eaaf26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:47.778991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:47.779626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8e0d6a89-1683-4761-9bf1-659e10316336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:47.781346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1322/2631] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:47 2022] DELETE /identity/v3/projects/230703dc98a84e219cf9d2b6f9eaaf26 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:52.204639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:52.206167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:52.219795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284b32-f348-44c1-8e01-edae48fa3b8e service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:52.228422 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:52.277116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:52.277733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:52.278011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:52.278284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] PATH_INFO: `/v3/users/37d38ce78cc3456ead41297bbc7a8cc2` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:52.279452 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d38ce78cc3456ead41297bbc7a8cc2)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:52.281972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:52.425364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d38ce78cc3456ead41297bbc7a8cc2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:52.432129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d38ce78cc3456ead41297bbc7a8cc2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:52.497065 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d38ce78cc3456ead41297bbc7a8cc2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:52.497683 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d38ce78cc3456ead41297bbc7a8cc2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:52.511535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d38ce78cc3456ead41297bbc7a8cc2'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:52.523773 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1310/2632] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:52 2022] DELETE /identity/v3/users/37d38ce78cc3456ead41297bbc7a8cc2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:52.528265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:52.528765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:52.528864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:52.549182 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:52.550388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:52.609935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1323/2633] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:52.621233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:52.622732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:52.682991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee409f5-6136-4d50-965d-1b984ab13db8 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:52.686869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:52.687570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:52.687873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:52.688116 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:52.697827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:52.699298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:52.710031 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1311/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:58:53.146063 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:53.147686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:53.160780 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ae138-7f82-4baf-bd75-3854ea3844b6 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:53.165642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:53.170500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:53.170500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:53.170500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] PATH_INFO: `/v3/projects/c96eb3ac63a347cdb9d6242b5638b0bc` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:53.170500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96eb3ac63a347cdb9d6242b5638b0bc)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:53.170500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:53.264943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96eb3ac63a347cdb9d6242b5638b0bc', 'request_id': 'req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.272374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96eb3ac63a347cdb9d6242b5638b0bc', 'request_id': 'req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.338384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96eb3ac63a347cdb9d6242b5638b0bc', 'request_id': 'req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.350276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] The token cache is being invalidate because project c96eb3ac63a347cdb9d6242b5638b0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:53.350606 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.351262 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.352774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1324/2635] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:53 2022] DELETE /identity/v3/projects/c96eb3ac63a347cdb9d6242b5638b0bc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:53.356976 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:53.366994 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2708140-3593-46f1-849b-87ce66969864 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:53.399611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:53.425151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:53.425735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:53.426015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:53.426293 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] PATH_INFO: `/v3/users/ca663e0a27d848d89b49fdac14504769` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:53.427443 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca663e0a27d848d89b49fdac14504769)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:53.429385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:53.574058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca663e0a27d848d89b49fdac14504769'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.574762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca663e0a27d848d89b49fdac14504769'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.664097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca663e0a27d848d89b49fdac14504769'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.664711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca663e0a27d848d89b49fdac14504769'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.677528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58f5ba7e-4b90-4774-8d81-560245eb6b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca663e0a27d848d89b49fdac14504769'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:53.690560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1312/2636] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:58:53 2022] DELETE /identity/v3/users/ca663e0a27d848d89b49fdac14504769 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:54.151146 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:54.152563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:54.166145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb42fc-6a72-4aec-9cdf-ac2841f3da99 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:54.224506 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:54.225138 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.225416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.225691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] PATH_INFO: `/v3/projects/b6c6768a4f664234bc7e8121bdc2f3b0` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.226837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c6768a4f664234bc7e8121bdc2f3b0)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:54.228732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:54.249388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:54.333429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c6768a4f664234bc7e8121bdc2f3b0', 'request_id': 'req-8f6fed82-b75d-41a9-9be8-8a62563310ba'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:54.340061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c6768a4f664234bc7e8121bdc2f3b0', 'request_id': 'req-8f6fed82-b75d-41a9-9be8-8a62563310ba'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:54.424048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c6768a4f664234bc7e8121bdc2f3b0', 'request_id': 'req-8f6fed82-b75d-41a9-9be8-8a62563310ba'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:54.436323 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] The token cache is being invalidate because project b6c6768a4f664234bc7e8121bdc2f3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:58:54.436616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:54.437292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8f6fed82-b75d-41a9-9be8-8a62563310ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:58:54.439212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1325/2637] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:58:54 2022] DELETE /identity/v3/projects/b6c6768a4f664234bc7e8121bdc2f3b0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:54.444329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.446928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.447221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.467661 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:54.469458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:54.531832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1313/2638] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:58:54.539858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.540144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.540424 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.561910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:54.563679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:54.575960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1326/2639] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:54.580802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:54.590438 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4de45d-5439-44bf-b7b5-84a580851c8d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:54.595972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:54.596563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.596839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.597104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.599591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:58:54.599591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:54.599591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:54.611607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1314/2640] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:58:54.615843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:54.626099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc729f-42a1-4b2d-b0cc-dfaa840b888c None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:54.631127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:54.631724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.632004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.632275 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.632914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:54.634910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:54.735038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1327/2641] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:54 2022] POST /identity/v3/projects => generated 357 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:54.739237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:54.750644 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcabe0-e1d0-4abc-a74a-9afc9e9242d1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:54.791934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:54.809415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:54.810011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.810295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.810597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.811476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:54.813993 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:54.927930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1315/2642] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:54 2022] POST /identity/v3/users => generated 279 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:54.931945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:54.943942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636daa51-97b2-478e-aa77-21cb298a0652 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:54.948749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:54.949423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.949727 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.950143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.950817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:54.952384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:54.963867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1328/2643] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:54.967966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:54.978882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c395-2326-4cbb-9bee-ecc3a7307f2c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:54.983636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488aff0b-d64a-44b1-8c3b-9c78c40c9073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:54.984348 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aff0b-d64a-44b1-8c3b-9c78c40c9073 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:54.984857 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aff0b-d64a-44b1-8c3b-9c78c40c9073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:54.985308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488aff0b-d64a-44b1-8c3b-9c78c40c9073 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:54.986059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488aff0b-d64a-44b1-8c3b-9c78c40c9073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:54.988524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488aff0b-d64a-44b1-8c3b-9c78c40c9073 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.002508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1316/2644] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:55.006012 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.017731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1b02-e942-4b04-8ee2-ed9cc6c29954 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.022445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.023134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.023417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.023694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] PATH_INFO: `/v3/projects/8f6c82c4ef5e449aa0c267fdf4a609c3/users/fdd6d4a613be4f7d97a663e189aac9d5/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.040032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6c82c4ef5e449aa0c267fdf4a609c3, user_id=fdd6d4a613be4f7d97a663e189aac9d5, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.042798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.127808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1329/2645] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:55 2022] PUT /identity/v3/projects/8f6c82c4ef5e449aa0c267fdf4a609c3/users/fdd6d4a613be4f7d97a663e189aac9d5/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:55.138185 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.138490 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.138782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.167465 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] MFA Rules not processed for user `fdd6d4a613be4f7d97a663e189aac9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:55.168954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:55.237053 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1317/2646] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:55.241640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.306997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d698d3-f019-4dfb-bbfa-23fecf833450 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.311703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.312946 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.313403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.313778 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.314367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.316295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.447304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1330/2647] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:58:55 2022] POST /identity/v3/projects => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:55.448372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.460247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd05ca-4d00-4d81-a941-6de428b3506d None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.517652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.518258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.518606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.518887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.519526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.521553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.612992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1318/2648] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:58:55 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:58:55.616966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.627650 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c5cb-630f-4fa8-85bc-0ef201f7cfe8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.632343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.632949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.633227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.633636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.634281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.635867 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.648887 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1331/2649] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:55.653268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.665579 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dd524-c68d-48d9-8df9-05388e25896b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.672778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.673517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.673792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.674069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] PATH_INFO: `/v3/projects/be620a214097448587930585ca6b2412/users/ee0dff03ecfe4c44b9dbb1c10ba7ae5c/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.699808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be620a214097448587930585ca6b2412, user_id=ee0dff03ecfe4c44b9dbb1c10ba7ae5c, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.702581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.864588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1319/2650] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:55 2022] PUT /identity/v3/projects/be620a214097448587930585ca6b2412/users/ee0dff03ecfe4c44b9dbb1c10ba7ae5c/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:58:55.868844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.879840 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d735129-094e-40de-8038-29219f971cb1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.892639 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:55.935066 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10844962-baf2-47ee-8af1-07f2c68d7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.935670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844962-baf2-47ee-8af1-07f2c68d7112 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.936192 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844962-baf2-47ee-8af1-07f2c68d7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.936467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844962-baf2-47ee-8af1-07f2c68d7112 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.937108 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844962-baf2-47ee-8af1-07f2c68d7112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.939322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844962-baf2-47ee-8af1-07f2c68d7112 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.948892 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1332/2651] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:58:55.953947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:55.964358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836923-35eb-4c73-8eeb-a96d1f9b19eb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:55.969139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:55.969784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:55.970061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:55.970329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] PATH_INFO: `/v3/projects/be620a214097448587930585ca6b2412/users/ee0dff03ecfe4c44b9dbb1c10ba7ae5c/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:55.972404 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be620a214097448587930585ca6b2412, user_id=ee0dff03ecfe4c44b9dbb1c10ba7ae5c, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:55.975095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:55.988684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1320/2652] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:58:55 2022] PUT /identity/v3/projects/be620a214097448587930585ca6b2412/users/ee0dff03ecfe4c44b9dbb1c10ba7ae5c/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:58:56.003402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:56.003695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:56.003975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:56.033289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] MFA Rules not processed for user `ee0dff03ecfe4c44b9dbb1c10ba7ae5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:58:56.038742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:56.107816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1333/2653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:58:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:58:56.120316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:56.122063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:56.127829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:58:56.198735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0248779-238d-455a-86d8-96c65d56fe14 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:56.198735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:56.198735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:56.198735 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:56.199051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:56.207883 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:56.209327 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:56.220044 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1321/2654] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:56.462313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:56.480188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838939-6a9b-4a95-9422-a861298a8d18 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:56.483171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:56.483934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:56.484218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:56.484494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:56.549034 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:56.550794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:56.561242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1334/2655] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:58:58.979909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:58:58.981294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:59.037379 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439216e-18d2-4043-9ad7-17f883517cc2 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:58:59.041002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:58:59.041615 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:58:59.041894 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:58:59.042166 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:58:59.044195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:58:59.107018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:58:59.108441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:58:59.118498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1322/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:58:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:03.451437 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:03.461202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678aefe-e8d4-4aab-b63f-e6d3f72bb8ae service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:03.464932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:03.465526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:03.465807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:03.466082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:03.467851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:03.503749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:03.533322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:03.534809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:03.544756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1335/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:07.183755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:07.187809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:07.205009 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cdf03-ecdb-412e-8287-9d6523d257cf service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:07.210059 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:07.210929 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:07.211259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:07.211535 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] PATH_INFO: `/v3/users/d12e9c1e41264150b70ab2cf08c78b1b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:07.212847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12e9c1e41264150b70ab2cf08c78b1b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:07.214788 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:07.421126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12e9c1e41264150b70ab2cf08c78b1b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:07.422453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12e9c1e41264150b70ab2cf08c78b1b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:07.424977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:07.521010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12e9c1e41264150b70ab2cf08c78b1b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:07.521969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12e9c1e41264150b70ab2cf08c78b1b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:07.535197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b12fe11b-33b5-4023-9f97-f0a3a3a106ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12e9c1e41264150b70ab2cf08c78b1b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:07.548126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1323/2658] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:07 2022] DELETE /identity/v3/users/d12e9c1e41264150b70ab2cf08c78b1b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:07.803081 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:07.814186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ec231-eab2-417d-8065-5515f01db398 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:07.878277 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:07.878942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:07.879312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:07.879530 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] PATH_INFO: `/v3/projects/ef9e0f5a3e3a423fbd778a6218543a20` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:07.880681 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9e0f5a3e3a423fbd778a6218543a20)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:07.882598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.018588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9e0f5a3e3a423fbd778a6218543a20', 'request_id': 'req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:08.024759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9e0f5a3e3a423fbd778a6218543a20', 'request_id': 'req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:08.110260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9e0f5a3e3a423fbd778a6218543a20', 'request_id': 'req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:08.121288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] The token cache is being invalidate because project ef9e0f5a3e3a423fbd778a6218543a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:08.127438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:08.127438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-e56ff3c4-3c4f-485a-823e-43c8f11f34c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:08.127438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1336/2659] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:07 2022] DELETE /identity/v3/projects/ef9e0f5a3e3a423fbd778a6218543a20 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:08.128675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109995-708f-40fc-9f57-49b87957633a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.128957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109995-708f-40fc-9f57-49b87957633a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.129228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109995-708f-40fc-9f57-49b87957633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.148688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-01109995-708f-40fc-9f57-49b87957633a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:08.149799 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-01109995-708f-40fc-9f57-49b87957633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:08.207978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1324/2660] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:08.216766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.217055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.217330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.237603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:08.238841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:08.246619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1337/2661] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:59:08.251509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109995-708f-40fc-9f57-49b87957633a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.261120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109995-708f-40fc-9f57-49b87957633a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.265694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.266292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.266607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.266880 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.267518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:59:08.268071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.269384 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.281913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1325/2662] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:59:08.286395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.296299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcabb50-8438-49f1-9944-d3a1bdd5aa41 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.301890 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.304878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.304878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.304878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.304878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.305594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.391289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1338/2663] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:08 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:08.395648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.406705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9011748-c5e8-48e0-a1aa-025a5d029b5a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.464724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.465521 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.465744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.466022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.466687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.468831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.553551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1326/2664] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:08 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:08.555109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.565507 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2583dc-97d6-43be-8735-c2cf458f27f4 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.570214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.570838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.571165 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.571432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.572067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.573765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.584214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1339/2665] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:08.590398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.599014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6219-2872-4e64-8815-7721827d6cc5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.603627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87820b9a-9fcd-4d87-8c32-893d5a08d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.604219 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820b9a-9fcd-4d87-8c32-893d5a08d66b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.604498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820b9a-9fcd-4d87-8c32-893d5a08d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.604792 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87820b9a-9fcd-4d87-8c32-893d5a08d66b admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.605488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87820b9a-9fcd-4d87-8c32-893d5a08d66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.607267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87820b9a-9fcd-4d87-8c32-893d5a08d66b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.619496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1327/2666] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:08.626087 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.638512 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf62ee-d06d-48f4-9a98-98e4f2ca215a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.644102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.644754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.645040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.645320 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] PATH_INFO: `/v3/projects/fece51e5e75c4e7d8ae7bf6db3f8eb98/users/05c8d70b5a9146a0a0d18886b86a8ae1/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.661110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fece51e5e75c4e7d8ae7bf6db3f8eb98, user_id=05c8d70b5a9146a0a0d18886b86a8ae1, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.663805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:08.773387 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:08.778993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1340/2667] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:08 2022] PUT /identity/v3/projects/fece51e5e75c4e7d8ae7bf6db3f8eb98/users/05c8d70b5a9146a0a0d18886b86a8ae1/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:08.789381 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.789694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.789975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.822878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] MFA Rules not processed for user `05c8d70b5a9146a0a0d18886b86a8ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:08.824254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:08.845712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:08.894365 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1328/2668] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:08.898532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:08.963390 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1cd5-d4a8-4cec-92cb-560e36e692be admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:08.968225 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:08.968877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:08.969301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:08.969570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:08.970195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:08.972172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.059227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1341/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:08 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:09.063905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:09.075650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765272fa-3d72-475d-90ee-45fcee155aa9 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:09.132755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:09.133358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.133636 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.133935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.134591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:09.136551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.229307 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1329/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:09 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:09.233311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:09.244550 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f8f6-f090-48cb-8885-09dba39c345a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:09.249417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:09.250620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.250894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.251167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.251809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:09.253441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.264341 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1342/2671] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:09.268923 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:09.278954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580833-3139-409c-97a0-41f1bd8c11bb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:09.284277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:09.284920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.285198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.285468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] PATH_INFO: `/v3/projects/1da1566d8bd746228d42faf2c683e578/users/1c162d6c9bd84fbd95c89e295aa6bf55/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.301061 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da1566d8bd746228d42faf2c683e578, user_id=1c162d6c9bd84fbd95c89e295aa6bf55, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:09.303789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.413027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1330/2672] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:09 2022] PUT /identity/v3/projects/1da1566d8bd746228d42faf2c683e578/users/1c162d6c9bd84fbd95c89e295aa6bf55/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:09.417243 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:09.429186 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da35b4-dda4-465f-889c-b066b0a30cad admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:09.488579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c963-7f7a-416b-abb2-ae2d5b17b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:09.489105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c963-7f7a-416b-abb2-ae2d5b17b10f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.489380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c963-7f7a-416b-abb2-ae2d5b17b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.489648 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c963-7f7a-416b-abb2-ae2d5b17b10f admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.490326 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c963-7f7a-416b-abb2-ae2d5b17b10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:09.492133 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c963-7f7a-416b-abb2-ae2d5b17b10f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.503136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1343/2673] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:09.507630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:09.519319 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535a9b1-448c-4629-839e-8ca58b0c1f4d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:09.524052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:09.524703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.524983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.525262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] PATH_INFO: `/v3/projects/1da1566d8bd746228d42faf2c683e578/users/1c162d6c9bd84fbd95c89e295aa6bf55/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.527244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da1566d8bd746228d42faf2c683e578, user_id=1c162d6c9bd84fbd95c89e295aa6bf55, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:09.529852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.541110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1331/2674] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:09 2022] PUT /identity/v3/projects/1da1566d8bd746228d42faf2c683e578/users/1c162d6c9bd84fbd95c89e295aa6bf55/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:09.553687 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.553984 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.554253 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.583679 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] MFA Rules not processed for user `1c162d6c9bd84fbd95c89e295aa6bf55`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:09.584896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:09.646750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:09.658127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1344/2675] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:09.671645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:09.673611 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:09.735401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17888-47c3-40d2-a88b-92a9dba244dd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:09.739108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:09.739647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:09.739919 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:09.740186 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:09.769392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:09.797707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:09.799201 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:09.807859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1332/2676] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:12.985815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:13.003179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07b9e3-85c8-4771-b445-0b440cda7320 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:13.007024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e4119-e876-4f4c-8847-11da2515a3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:13.007633 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4119-e876-4f4c-8847-11da2515a3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:13.007911 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4119-e876-4f4c-8847-11da2515a3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:13.008195 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e4119-e876-4f4c-8847-11da2515a3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:13.017993 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4119-e876-4f4c-8847-11da2515a3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:13.019454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e4119-e876-4f4c-8847-11da2515a3a8 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:13.029758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1345/2677] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:14.629529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:14.630954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:14.696751 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e583b2-5112-4ee5-9f3a-029e73abdf02 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:14.701285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:14.701912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:14.702192 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:14.702461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] PATH_INFO: `/v3/users/fdd6d4a613be4f7d97a663e189aac9d5` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:14.704795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd6d4a613be4f7d97a663e189aac9d5)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:14.709592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:14.884781 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd6d4a613be4f7d97a663e189aac9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:14.885432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd6d4a613be4f7d97a663e189aac9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:14.972176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd6d4a613be4f7d97a663e189aac9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:14.972737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd6d4a613be4f7d97a663e189aac9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:14.987560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd6d4a613be4f7d97a663e189aac9d5'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:15.001488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1333/2678] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:14 2022] DELETE /identity/v3/users/fdd6d4a613be4f7d97a663e189aac9d5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:15.006008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:15.006545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:15.006644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:15.025894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:15.027119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:15.087468 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1346/2679] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:15.097239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:15.098701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:15.161017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:15.164762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e3f7-b248-424e-b504-359e177862b5 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:15.168430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:15.172801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:15.172801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:15.172801 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:15.179588 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:15.181010 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:15.191484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1334/2680] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:15.609841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:15.610024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:15.628978 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fbf77-e14b-40b0-a03f-a1ce8cd1a2fe None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:15.633700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:15.634336 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:15.634647 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:15.634920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] PATH_INFO: `/v3/projects/8f6c82c4ef5e449aa0c267fdf4a609c3` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:15.636045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6c82c4ef5e449aa0c267fdf4a609c3)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:15.637930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:15.767003 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6c82c4ef5e449aa0c267fdf4a609c3', 'request_id': 'req-2adbec94-42ce-4774-a976-245843aaff88'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:15.773364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6c82c4ef5e449aa0c267fdf4a609c3', 'request_id': 'req-2adbec94-42ce-4774-a976-245843aaff88'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:15.846302 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6c82c4ef5e449aa0c267fdf4a609c3', 'request_id': 'req-2adbec94-42ce-4774-a976-245843aaff88'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:15.857215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] The token cache is being invalidate because project 8f6c82c4ef5e449aa0c267fdf4a609c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:15.857440 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:15.858058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:15.860125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1347/2681] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:15 2022] DELETE /identity/v3/projects/8f6c82c4ef5e449aa0c267fdf4a609c3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:15.864209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:15.873656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41441d-e18e-4e20-94e0-7ffab6027b57 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:15.931332 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:15.931960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:15.932239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:15.932510 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] PATH_INFO: `/v3/users/ee0dff03ecfe4c44b9dbb1c10ba7ae5c` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:15.933631 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0dff03ecfe4c44b9dbb1c10ba7ae5c)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:15.935580 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:16.112341 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0dff03ecfe4c44b9dbb1c10ba7ae5c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.112955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0dff03ecfe4c44b9dbb1c10ba7ae5c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.185021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0dff03ecfe4c44b9dbb1c10ba7ae5c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.185021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0dff03ecfe4c44b9dbb1c10ba7ae5c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.195279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d8d9bfc6-47f9-441e-a6cb-6af512d96eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0dff03ecfe4c44b9dbb1c10ba7ae5c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.208971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1335/2682] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:15 2022] DELETE /identity/v3/users/ee0dff03ecfe4c44b9dbb1c10ba7ae5c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:16.601855 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:16.603526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:16.619585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbec94-42ce-4774-a976-245843aaff88 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:16.697802 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:16.698434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:16.698742 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:16.699013 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] PATH_INFO: `/v3/projects/be620a214097448587930585ca6b2412` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:16.700125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be620a214097448587930585ca6b2412)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:16.702008 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:16.712577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:16.825335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be620a214097448587930585ca6b2412', 'request_id': 'req-f377cca1-4b18-46b7-a807-54a44af4f844'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.831718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be620a214097448587930585ca6b2412', 'request_id': 'req-f377cca1-4b18-46b7-a807-54a44af4f844'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.875120 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be620a214097448587930585ca6b2412', 'request_id': 'req-f377cca1-4b18-46b7-a807-54a44af4f844'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.886091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] The token cache is being invalidate because project be620a214097448587930585ca6b2412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:16.886322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.887093 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f377cca1-4b18-46b7-a807-54a44af4f844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:16.888662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1348/2683] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:16 2022] DELETE /identity/v3/projects/be620a214097448587930585ca6b2412 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:16.894080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:16.897283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:16.897283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:16.915230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:16.916477 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:16.976505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1336/2684] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:16.985177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:16.985468 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:16.985744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.005509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:17.006754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:17.014689 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1349/2685] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:17.019036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.029386 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ce63b-4012-4438-b3f8-fbeb0f3fcc99 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.034809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.035405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.035681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.035951 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.036725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:59:17.037027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.039019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.046113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:17.052126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1337/2686] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:59:17.056594 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.066077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67036103-4a4e-4eb1-9579-bc714dc73c87 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.070856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.071452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.071733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.072006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.072631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.074555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.179499 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1350/2687] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:17 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:17.183839 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.194227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa7749-087d-4ddf-8dde-25af4f7a312a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.253094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.253694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.253971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.254240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.254909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.256810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.338771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1338/2688] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:17 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:17.342720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.353050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892306b3-0f40-4918-a872-a1f833bea531 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.357661 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.358249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.358559 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.358831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.359970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.361565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.371357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1351/2689] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:17.376537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.386812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c7536-3666-4e71-b5f4-bdd7aff086da admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.391998 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5936a1-7e2a-4c7e-afce-fd3599da18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.392586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5936a1-7e2a-4c7e-afce-fd3599da18ad admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.392859 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5936a1-7e2a-4c7e-afce-fd3599da18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.393133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5936a1-7e2a-4c7e-afce-fd3599da18ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.393761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5936a1-7e2a-4c7e-afce-fd3599da18ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.395376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5936a1-7e2a-4c7e-afce-fd3599da18ad admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.405129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1339/2690] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:17.409432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.419577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473fa35a-a705-406b-a23a-ebef9667678b admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.424835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.425470 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.425749 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.426053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] PATH_INFO: `/v3/projects/0957e48f56b34bc8a4ebbdb7e8a1d87d/users/d727ba5f5f884de3a4c3d82742950ace/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.442098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0957e48f56b34bc8a4ebbdb7e8a1d87d, user_id=d727ba5f5f884de3a4c3d82742950ace, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.444680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.497881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1352/2691] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:17 2022] PUT /identity/v3/projects/0957e48f56b34bc8a4ebbdb7e8a1d87d/users/d727ba5f5f884de3a4c3d82742950ace/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:17.510120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.510409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.510722 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.538358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] MFA Rules not processed for user `d727ba5f5f884de3a4c3d82742950ace`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:17.539666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:17.603985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1340/2692] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:17.611268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.817115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864950c-d0f9-4f6a-828a-58608a53e5f8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.821734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.822419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.822671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.822941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.823568 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.825454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:17.905666 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1353/2693] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:17 2022] POST /identity/v3/projects => generated 367 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:17.910727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:17.921517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7dcda-4986-4313-a44d-6253fd3c3425 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:17.988909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:17.989950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:17.990441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:17.990955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:17.992077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:17.994721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.006179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:18.124058 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1341/2694] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:17 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:18.125193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:18.135688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4350f8-0985-4502-8fa9-8744edc0252d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:18.140366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:18.140964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.142136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.142136 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.142997 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:18.144600 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.155020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1354/2695] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:18.159697 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:18.169905 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12183ed-c1e7-4404-9f52-9d95588506e2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:18.175577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:18.176222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.176504 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.176778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] PATH_INFO: `/v3/projects/688f27b1079b480c9e6d696331eb9433/users/60e2e94134fc4db583d804306a91bbfe/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.191637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] RBAC: Authorizing `identity:create_grant(project_id=688f27b1079b480c9e6d696331eb9433, user_id=60e2e94134fc4db583d804306a91bbfe, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:18.194278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.263455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1342/2696] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:18 2022] PUT /identity/v3/projects/688f27b1079b480c9e6d696331eb9433/users/60e2e94134fc4db583d804306a91bbfe/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:18.268148 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:18.274460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:18.278143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dc3dc-9edd-4663-96bf-3c9600ddc2b0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:18.335245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf9a12-b51c-469a-97d3-6cbb46a6aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:18.335863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9a12-b51c-469a-97d3-6cbb46a6aa9f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.336144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9a12-b51c-469a-97d3-6cbb46a6aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.336412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf9a12-b51c-469a-97d3-6cbb46a6aa9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.337043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9a12-b51c-469a-97d3-6cbb46a6aa9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:18.338701 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf9a12-b51c-469a-97d3-6cbb46a6aa9f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.348640 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1355/2697] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:18.353012 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:18.363606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77b812-a79d-4f8d-8dde-4fb925a5203d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:18.368385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:18.369027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.369313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.369589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] PATH_INFO: `/v3/projects/688f27b1079b480c9e6d696331eb9433/users/60e2e94134fc4db583d804306a91bbfe/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.371721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688f27b1079b480c9e6d696331eb9433, user_id=60e2e94134fc4db583d804306a91bbfe, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:18.374336 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.385230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1343/2698] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:18 2022] PUT /identity/v3/projects/688f27b1079b480c9e6d696331eb9433/users/60e2e94134fc4db583d804306a91bbfe/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:18.396098 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.396385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.396660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.424691 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] MFA Rules not processed for user `60e2e94134fc4db583d804306a91bbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:18.425909 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:18.494430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1356/2699] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:18.506572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:18.508292 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:18.565767 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c0bc4-4d88-45a0-975c-9bf7fbe4ece1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:18.569425 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:18.570020 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.570296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.570624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.580039 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:18.581449 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.590659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1344/2700] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:18.696621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:18.697999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:18.714158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce04430-165a-488a-9ba5-afae724d4b96 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:18.717857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ee801-30dc-4aef-8b3f-418a248c9a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:18.718456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee801-30dc-4aef-8b3f-418a248c9a1e service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:18.718761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee801-30dc-4aef-8b3f-418a248c9a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:18.719032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee801-30dc-4aef-8b3f-418a248c9a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:18.774634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ee801-30dc-4aef-8b3f-418a248c9a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:18.775964 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ee801-30dc-4aef-8b3f-418a248c9a1e service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:18.784772 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1357/2701] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:23.872869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:23.937961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5545ad-ff35-4a66-92a2-b5b4e6413bf4 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:23.943070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:23.943693 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:23.943972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:23.944244 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] PATH_INFO: `/v3/users/d727ba5f5f884de3a4c3d82742950ace` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:23.945359 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d727ba5f5f884de3a4c3d82742950ace)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:23.947304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:24.169423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd727ba5f5f884de3a4c3d82742950ace'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:24.170003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd727ba5f5f884de3a4c3d82742950ace'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:24.240551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd727ba5f5f884de3a4c3d82742950ace'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:24.241174 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd727ba5f5f884de3a4c3d82742950ace'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:24.248592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:24.254709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd727ba5f5f884de3a4c3d82742950ace'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:24.266858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1345/2702] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:23 2022] DELETE /identity/v3/users/d727ba5f5f884de3a4c3d82742950ace => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:24.271489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:24.271960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:24.272060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:24.291213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:24.292416 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:24.311489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=100 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:24.351567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1358/2703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:24.361308 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:24.363748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:24.420701 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e3fbb-f929-4ebc-8686-b92e2b7f52bc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:24.424239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:24.424832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:24.425687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:24.426171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:24.434893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:24.436314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:24.445607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1346/2704] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:24.827966 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:24.829460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:24.844041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a0b6e-9ef5-4a7e-9237-b4caa3d4e441 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:24.857881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:24.858563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:24.858842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:24.859111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] PATH_INFO: `/v3/projects/0957e48f56b34bc8a4ebbdb7e8a1d87d` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:24.860278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0957e48f56b34bc8a4ebbdb7e8a1d87d)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:24.862157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:24.958576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0957e48f56b34bc8a4ebbdb7e8a1d87d', 'request_id': 'req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:24.964961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0957e48f56b34bc8a4ebbdb7e8a1d87d', 'request_id': 'req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.051848 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0957e48f56b34bc8a4ebbdb7e8a1d87d', 'request_id': 'req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.062906 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] The token cache is being invalidate because project 0957e48f56b34bc8a4ebbdb7e8a1d87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:25.063191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.063812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.065293 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1359/2705] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:24 2022] DELETE /identity/v3/projects/0957e48f56b34bc8a4ebbdb7e8a1d87d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:25.070164 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:25.080385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f1493-dd79-4947-af4d-f3ba3006740f service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:25.139939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:25.144707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:25.144707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:25.144707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] PATH_INFO: `/v3/users/60e2e94134fc4db583d804306a91bbfe` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:25.144707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e2e94134fc4db583d804306a91bbfe)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:25.145051 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:25.323623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e2e94134fc4db583d804306a91bbfe'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.324495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e2e94134fc4db583d804306a91bbfe'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.383741 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e2e94134fc4db583d804306a91bbfe'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.384560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e2e94134fc4db583d804306a91bbfe'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.398416 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-4c041b9a-c202-4bee-a03e-11b1719c9519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e2e94134fc4db583d804306a91bbfe'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:25.411494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1347/2706] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:25 2022] DELETE /identity/v3/users/60e2e94134fc4db583d804306a91bbfe => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:25.819536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:25.824842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:25.836289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcab6-8b55-4cd6-981d-dc9c2a10b2f8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:25.895933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:25.896566 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:25.896846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:25.897118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] PATH_INFO: `/v3/projects/688f27b1079b480c9e6d696331eb9433` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:25.898251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688f27b1079b480c9e6d696331eb9433)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:25.900161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.041377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688f27b1079b480c9e6d696331eb9433', 'request_id': 'req-af8be807-2bdd-4061-af50-8a3f8a43e548'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:26.042456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:26.048748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688f27b1079b480c9e6d696331eb9433', 'request_id': 'req-af8be807-2bdd-4061-af50-8a3f8a43e548'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:26.114933 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688f27b1079b480c9e6d696331eb9433', 'request_id': 'req-af8be807-2bdd-4061-af50-8a3f8a43e548'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:26.125449 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] The token cache is being invalidate because project 688f27b1079b480c9e6d696331eb9433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:26.125737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:26.126343 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-af8be807-2bdd-4061-af50-8a3f8a43e548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:26.127835 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1360/2707] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:25 2022] DELETE /identity/v3/projects/688f27b1079b480c9e6d696331eb9433 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:26.132932 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.133383 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.133498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.141052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:26.155518 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:26.156740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:26.336775 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1348/2708] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:26.345585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.345800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.346068 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.367347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:26.368598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:26.379746 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1361/2709] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:26.384096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:26.394497 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32bad-e6bd-43d6-8fc2-a37e56d91759 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:26.399036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:26.399643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.399904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.400176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.400817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:59:26.401119 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:26.402737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.415248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1349/2710] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:59:26.419816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:26.428952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0c48-bc8d-4099-9bfb-cfb63ce9e0f2 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:26.433585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:26.434175 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.434451 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.434823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.435463 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:26.437318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.522599 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1362/2711] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:26 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:26.527212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:26.537618 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce107e-cccc-4b57-a90e-9d210aeea735 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:26.592925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:26.593500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.593779 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.594054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.594835 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:26.596787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.693139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1350/2712] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:26 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:26.697303 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:26.708105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8104c-838f-41af-a7a1-fa8b0c076bec admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:26.712983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:26.713645 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.713979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.714260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.714942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:26.716528 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.727103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1363/2713] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:26.731434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:26.741688 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43603f06-f24d-4833-a285-ef6638fc4f96 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:26.747413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66acfc-4328-4da1-b8f4-a113a7bd2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:26.748467 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66acfc-4328-4da1-b8f4-a113a7bd2b32 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.748973 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66acfc-4328-4da1-b8f4-a113a7bd2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.749455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66acfc-4328-4da1-b8f4-a113a7bd2b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.750668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66acfc-4328-4da1-b8f4-a113a7bd2b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:26.754172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66acfc-4328-4da1-b8f4-a113a7bd2b32 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.765843 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1351/2714] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:26.770809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:26.781216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c4732-cf2f-44d3-b058-a5b66e12a2f7 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:26.786644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:26.787301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.787579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.787850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] PATH_INFO: `/v3/projects/fa6c5f4f22584f61ad2950423d9e00fc/users/a51f56aecd4a46ecb55912070f77be9a/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.803871 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6c5f4f22584f61ad2950423d9e00fc, user_id=a51f56aecd4a46ecb55912070f77be9a, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:26.806493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:26.881487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1364/2715] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:26 2022] PUT /identity/v3/projects/fa6c5f4f22584f61ad2950423d9e00fc/users/a51f56aecd4a46ecb55912070f77be9a/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:26.892920 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:26.893202 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:26.893476 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:26.923312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] MFA Rules not processed for user `a51f56aecd4a46ecb55912070f77be9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:26.924520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:26.984487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:26.989975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1352/2716] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:26.994705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.067847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220e928-4319-4b2f-b69b-f88af6e1fedf admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.072891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.073518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.073797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.074185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.074863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.076779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.173901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1365/2717] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:26 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:27.178793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.189672 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e920c21-237d-433d-838e-6af22470fe22 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.246162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.246797 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.247079 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.247352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.247975 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.249878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.326675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1353/2718] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:27 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:27.334759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.348824 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8fc74-8378-4a7d-94ef-0865cb0f043d admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.353596 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.354203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.354540 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.354820 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.355491 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.359245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.368616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1366/2719] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:27.372651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.382783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb9b6a-86df-45db-942f-c66860288a16 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.387712 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d3c54-27d5-4824-86eb-f4eab9adb5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.388314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3c54-27d5-4824-86eb-f4eab9adb5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.388598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3c54-27d5-4824-86eb-f4eab9adb5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.388871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3c54-27d5-4824-86eb-f4eab9adb5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.389512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d3c54-27d5-4824-86eb-f4eab9adb5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.391145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d3c54-27d5-4824-86eb-f4eab9adb5c0 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.401664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1354/2720] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:27.405768 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.416375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26704370-2205-4410-a9f1-c520d181ecd0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.421197 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.421841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.422118 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.422388 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] PATH_INFO: `/v3/projects/40395e85497e49bcb3cc7e33ae593a6f/users/0eb86a180ac94396ae3f06a2dd6c905f/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.437790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40395e85497e49bcb3cc7e33ae593a6f, user_id=0eb86a180ac94396ae3f06a2dd6c905f, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.440618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.520823 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1367/2721] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:27 2022] PUT /identity/v3/projects/40395e85497e49bcb3cc7e33ae593a6f/users/0eb86a180ac94396ae3f06a2dd6c905f/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:27.531321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.535195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.535195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.560695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] MFA Rules not processed for user `0eb86a180ac94396ae3f06a2dd6c905f`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:27.561869 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:27.624649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1355/2722] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:27.629562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.658121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:27.692657 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57bbb-d116-42e1-8912-929584b52077 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.697189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.697777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.698051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.698322 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.698973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.700846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.778828 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1368/2723] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:27 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:27.782872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.794018 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66c11-eceb-4e25-bbc5-7ab45611f190 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.850985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.851591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.851866 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.852160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.852784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.854824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.861139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.863104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:27.866733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:27.875797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f18bd-1211-4d33-82c1-0d189c31f1ad admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.880760 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.881380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.881663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.882206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] PATH_INFO: `/v3/users/05c8d70b5a9146a0a0d18886b86a8ae1` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.883096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c8d70b5a9146a0a0d18886b86a8ae1)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.884982 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.932330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1356/2724] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:27 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:27.936257 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.951760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae9ef7-4c90-4bd2-b8db-1bc76cedefde admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.954744 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.955350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.955628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.955897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:27.957288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:27.959022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:27.970052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1357/2725] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:59:27.977528 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:27.987259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15120e43-4b73-48f2-a59e-afa186c2142c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:27.991997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:27.992625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:27.992909 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:27.993167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] PATH_INFO: `/v3/projects/a1dbf3d0b92b493ea186f0a3be6e685c/users/13de8a04619841b1a2f12310d7c39ee5/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.010656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dbf3d0b92b493ea186f0a3be6e685c, user_id=13de8a04619841b1a2f12310d7c39ee5, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.013312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:28.066632 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c8d70b5a9146a0a0d18886b86a8ae1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:28.080821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1358/2726] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:27 2022] PUT /identity/v3/projects/a1dbf3d0b92b493ea186f0a3be6e685c/users/13de8a04619841b1a2f12310d7c39ee5/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:28.085852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:28.149954 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff96f0f-6d6b-4034-9184-5fb786274ad1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:28.154667 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:28.155264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.155393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c8d70b5a9146a0a0d18886b86a8ae1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:28.155537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.155806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.155995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c8d70b5a9146a0a0d18886b86a8ae1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:28.156435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.156616 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c8d70b5a9146a0a0d18886b86a8ae1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:28.158049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:28.164297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5f7c815e-2ba2-4deb-aa18-abb773efe44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c8d70b5a9146a0a0d18886b86a8ae1'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:28.168125 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1359/2727] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:59:28.172540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:28.174262 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.183782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1369/2728] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:27 2022] DELETE /identity/v3/users/05c8d70b5a9146a0a0d18886b86a8ae1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:28.187938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bc5f4-d0dd-42c7-92e1-1e6be1791bd1 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.188292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bc5f4-d0dd-42c7-92e1-1e6be1791bd1 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.188423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe0faf-4ca1-49ad-8be4-aa8e25f47d3f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:28.188905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bc5f4-d0dd-42c7-92e1-1e6be1791bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.208821 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-770bc5f4-d0dd-42c7-92e1-1e6be1791bd1 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:28.210187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-770bc5f4-d0dd-42c7-92e1-1e6be1791bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.247728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:28.248374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.248649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.248916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] PATH_INFO: `/v3/projects/a1dbf3d0b92b493ea186f0a3be6e685c/users/13de8a04619841b1a2f12310d7c39ee5/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.250821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dbf3d0b92b493ea186f0a3be6e685c, user_id=13de8a04619841b1a2f12310d7c39ee5, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.253938 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:28.265613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1360/2729] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:28 2022] PUT /identity/v3/projects/a1dbf3d0b92b493ea186f0a3be6e685c/users/13de8a04619841b1a2f12310d7c39ee5/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:28.269826 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1370/2730] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:59:28.279200 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:28.281699 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.281850 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.282179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.282458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.311067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] MFA Rules not processed for user `13de8a04619841b1a2f12310d7c39ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:28.312285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.323014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:28.341836 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0606-5c95-4206-aaf2-9648ec50970e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:28.345853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:28.346455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.346783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.347097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.351592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:28.384452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1371/2731] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:59:28.396295 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:28.397705 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.413576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.415048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:28.426230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1361/2732] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:28.455217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0021138-c3d7-40ad-bede-8a37a3b1390d None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:28.460128 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:28.460684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.460967 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.461239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.474403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.478940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:28.485498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1372/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:59:28.621608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:28.623081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.635851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab07fc-2904-4e85-9bf4-514f728902b5 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:28.639664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:28.640417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.640564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.640834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.642787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.707352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.707352 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:28.716114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1362/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:28.882351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:28.888619 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:28.907750 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3967-620f-426e-adc7-1bcacf915d79 service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:28.923301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:28.923936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:28.924211 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:28.924473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] PATH_INFO: `/v3/projects/fece51e5e75c4e7d8ae7bf6db3f8eb98` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:28.926188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fece51e5e75c4e7d8ae7bf6db3f8eb98)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:28.928071 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:29.019521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fece51e5e75c4e7d8ae7bf6db3f8eb98', 'request_id': 'req-1a499abf-ba35-47bf-b548-81fab6a06daf'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.025473 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fece51e5e75c4e7d8ae7bf6db3f8eb98', 'request_id': 'req-1a499abf-ba35-47bf-b548-81fab6a06daf'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.087179 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fece51e5e75c4e7d8ae7bf6db3f8eb98', 'request_id': 'req-1a499abf-ba35-47bf-b548-81fab6a06daf'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.101585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] The token cache is being invalidate because project fece51e5e75c4e7d8ae7bf6db3f8eb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:29.103685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.103685 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.104392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1373/2735] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:28 2022] DELETE /identity/v3/projects/fece51e5e75c4e7d8ae7bf6db3f8eb98 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:29.108819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:29.120867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6166-8261-41b1-afec-6b0a118a0e04 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:29.178702 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:29.179329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:29.179603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:29.179875 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] PATH_INFO: `/v3/users/1c162d6c9bd84fbd95c89e295aa6bf55` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:29.180990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c162d6c9bd84fbd95c89e295aa6bf55)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:29.182941 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:29.347559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:29.352826 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c162d6c9bd84fbd95c89e295aa6bf55'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.353491 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c162d6c9bd84fbd95c89e295aa6bf55'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.429594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c162d6c9bd84fbd95c89e295aa6bf55'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.430264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c162d6c9bd84fbd95c89e295aa6bf55'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.443882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d661e466-f209-4fd7-8c94-17a9697b7e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c162d6c9bd84fbd95c89e295aa6bf55'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:29.456755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1363/2736] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:29 2022] DELETE /identity/v3/users/1c162d6c9bd84fbd95c89e295aa6bf55 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:29.853610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:29.855142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:29.869610 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a499abf-ba35-47bf-b548-81fab6a06daf admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:29.902059 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:29.929481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:29.930112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:29.930392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:29.930693 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] PATH_INFO: `/v3/projects/1da1566d8bd746228d42faf2c683e578` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:29.931838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da1566d8bd746228d42faf2c683e578)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:29.933724 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.035736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da1566d8bd746228d42faf2c683e578', 'request_id': 'req-95b979e7-baca-4810-b196-4b4376c07861'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:30.042428 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da1566d8bd746228d42faf2c683e578', 'request_id': 'req-95b979e7-baca-4810-b196-4b4376c07861'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:30.143745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da1566d8bd746228d42faf2c683e578', 'request_id': 'req-95b979e7-baca-4810-b196-4b4376c07861'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:30.155127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] The token cache is being invalidate because project 1da1566d8bd746228d42faf2c683e578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:30.155417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:30.156054 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-95b979e7-baca-4810-b196-4b4376c07861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:30.157577 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1374/2737] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:29 2022] DELETE /identity/v3/projects/1da1566d8bd746228d42faf2c683e578 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:30.162514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.162802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.163105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.183354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:30.184532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:30.243109 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1364/2738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:30.251096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.251408 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.251677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.272707 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:30.273904 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:30.281656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1375/2739] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:30.286374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.296396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65c0ee-95f2-499d-a912-129958faf4ed None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.300991 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.302117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.302399 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.302711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.303349 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:59:30.303651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.305252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.316886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1365/2740] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:59:30.321156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.330573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c0874-d97d-4c51-ad6c-14967878d850 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.335292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.335884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.336158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.336425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.337041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.339019 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.436763 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1376/2741] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:30 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:30.441897 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.451617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f8c9-0c53-428d-9181-882f6fe34515 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.510598 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.511241 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.511514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.511784 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.512401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.514374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.596575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1366/2742] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:30 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:30.602248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.612663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035051-3b6d-4736-b9f9-48ff35867c99 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.617671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.618259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.618573 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.621607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.621607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.621607 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.631579 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1377/2743] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:30.635524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.646284 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d866a-8bc9-4628-ba34-5c3984d1a393 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.650874 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872451e-8771-48c0-8a81-0c26330d7b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.651460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872451e-8771-48c0-8a81-0c26330d7b47 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.651737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872451e-8771-48c0-8a81-0c26330d7b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.652007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872451e-8771-48c0-8a81-0c26330d7b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.652635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872451e-8771-48c0-8a81-0c26330d7b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.654196 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872451e-8771-48c0-8a81-0c26330d7b47 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.666121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1367/2744] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:30.670700 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.681110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ff935-4878-4214-8bed-c38fba48f191 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.685869 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.686548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.686833 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.687110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] PATH_INFO: `/v3/projects/c80503fc3e2c4b9eb236827625874578/users/414890c69e094fc18793259e8c34a70b/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.701974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80503fc3e2c4b9eb236827625874578, user_id=414890c69e094fc18793259e8c34a70b, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.704642 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.784281 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1378/2745] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:30 2022] PUT /identity/v3/projects/c80503fc3e2c4b9eb236827625874578/users/414890c69e094fc18793259e8c34a70b/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:30.790635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e9bee-0b2c-4d55-9eb6-cfae5ea974bb None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.790922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e9bee-0b2c-4d55-9eb6-cfae5ea974bb None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.791190 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e9bee-0b2c-4d55-9eb6-cfae5ea974bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.815660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9d9e9bee-0b2c-4d55-9eb6-cfae5ea974bb None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:30.816947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9d9e9bee-0b2c-4d55-9eb6-cfae5ea974bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:30.836011 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:30.876270 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1368/2746] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:30.886132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:30.888217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:30.947276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa30da-cb09-4cd1-a73e-a90898173719 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:30.954224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:30.954224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:30.954224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:30.954224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:30.964875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:30.966395 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:30.977076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1379/2747] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:32.002140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.002676 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.002786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.036333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] MFA Rules not processed for user `414890c69e094fc18793259e8c34a70b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:32.037961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:32.110809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1369/2748] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:32.115374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.120218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:32.125536 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ab45e-02cf-441e-97e3-c23de6ff149e service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.130570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.131168 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.131446 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.131716 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.132353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.134234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.231056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1380/2749] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:32 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:32.235240 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.248700 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59140d-87b6-4762-b07c-109bc97a3ef6 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.303021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.303632 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.303914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.304188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.304827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.306770 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.372432 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1370/2750] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:32 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:32.376703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.387413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd8c72-3df5-4b46-81ca-7c2995cbbd7c admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.392126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.392720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.393022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.393412 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.394044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.396367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.406272 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1381/2751] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:59:32.411211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.421275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8182d6a-a0f3-4a5f-bb64-e2359166a114 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.425811 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.426496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.426810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.427081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] PATH_INFO: `/v3/projects/e42ec9f047ec48dbac9fee4214f03e59/users/81094dd0e9504bcc97f3f3f2f790e0a1/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.441871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42ec9f047ec48dbac9fee4214f03e59, user_id=81094dd0e9504bcc97f3f3f2f790e0a1, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.444635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.479460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.481189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:32.493895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edad97-844d-47db-8fd6-f12d39210ace admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.498913 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.499471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.499754 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.500055 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] PATH_INFO: `/v3/users/a51f56aecd4a46ecb55912070f77be9a` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.501239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51f56aecd4a46ecb55912070f77be9a)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.503239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.567589 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1371/2752] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:32 2022] PUT /identity/v3/projects/e42ec9f047ec48dbac9fee4214f03e59/users/81094dd0e9504bcc97f3f3f2f790e0a1/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:32.571649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.592441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:32.636137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7c047-b003-4ada-b93f-b85728bf330f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.644165 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.645445 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.648159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.648675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.649391 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.651893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.662585 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1372/2753] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:59:32.666812 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.681733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541911-5bd9-4866-ac9b-016cddc2e073 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.686533 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f445-a013-4b60-939f-920a390aae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.687207 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f445-a013-4b60-939f-920a390aae69 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.687484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f445-a013-4b60-939f-920a390aae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.687759 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f445-a013-4b60-939f-920a390aae69 admin admin] PATH_INFO: `/v3/projects/e42ec9f047ec48dbac9fee4214f03e59/users/81094dd0e9504bcc97f3f3f2f790e0a1/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.689245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51f56aecd4a46ecb55912070f77be9a'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:32.689670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6f445-a013-4b60-939f-920a390aae69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42ec9f047ec48dbac9fee4214f03e59, user_id=81094dd0e9504bcc97f3f3f2f790e0a1, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:32.693022 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6f445-a013-4b60-939f-920a390aae69 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:32.703373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1373/2754] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:32 2022] PUT /identity/v3/projects/e42ec9f047ec48dbac9fee4214f03e59/users/81094dd0e9504bcc97f3f3f2f790e0a1/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:32.789287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51f56aecd4a46ecb55912070f77be9a'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:32.789856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51f56aecd4a46ecb55912070f77be9a'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:32.790513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51f56aecd4a46ecb55912070f77be9a'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:32.798433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51f56aecd4a46ecb55912070f77be9a'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:32.821622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1382/2755] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:32 2022] DELETE /identity/v3/users/a51f56aecd4a46ecb55912070f77be9a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:32.826530 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.826822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.828080 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:32.853351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:32.854605 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:32.916066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1374/2756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:59:32.926745 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:32.928189 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:32.987834 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36abfb-1c90-4a0d-ad7e-9bc5489825d5 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:32.992047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:32.992659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:32.992945 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:32.993217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:33.003052 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:33.005434 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:33.015563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1383/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:33.530731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:33.532402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:33.545267 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf86d0c-3306-4beb-a13a-700e1d613e04 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:33.550829 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:33.557694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:33.557694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:33.557694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] PATH_INFO: `/v3/projects/fa6c5f4f22584f61ad2950423d9e00fc` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:33.557694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6c5f4f22584f61ad2950423d9e00fc)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:33.557694 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:33.665045 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6c5f4f22584f61ad2950423d9e00fc', 'request_id': 'req-977dd906-1ca3-46ad-9b89-2f1b03349b31'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:33.671455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6c5f4f22584f61ad2950423d9e00fc', 'request_id': 'req-977dd906-1ca3-46ad-9b89-2f1b03349b31'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:33.783885 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6c5f4f22584f61ad2950423d9e00fc', 'request_id': 'req-977dd906-1ca3-46ad-9b89-2f1b03349b31'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:33.796831 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] The token cache is being invalidate because project fa6c5f4f22584f61ad2950423d9e00fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:33.801877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:33.801877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-977dd906-1ca3-46ad-9b89-2f1b03349b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:33.801877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1375/2758] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:33 2022] DELETE /identity/v3/projects/fa6c5f4f22584f61ad2950423d9e00fc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:33.803943 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:33.813584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060062c-9abb-40a5-bfd1-b407cfbb374f service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:33.855203 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:33.870753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:33.871384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:33.871658 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:33.871985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] PATH_INFO: `/v3/users/0eb86a180ac94396ae3f06a2dd6c905f` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:33.873102 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb86a180ac94396ae3f06a2dd6c905f)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:33.875030 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:34.009091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8f4-c840-48f0-b587-af5fe8add576 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:34.009373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8f4-c840-48f0-b587-af5fe8add576 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:34.009680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8f4-c840-48f0-b587-af5fe8add576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:34.041668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-00bfb8f4-c840-48f0-b587-af5fe8add576 None None] MFA Rules not processed for user `81094dd0e9504bcc97f3f3f2f790e0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:34.043107 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-00bfb8f4-c840-48f0-b587-af5fe8add576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.044782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb86a180ac94396ae3f06a2dd6c905f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.058144 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:34.120131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1376/2759] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:34.126501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb86a180ac94396ae3f06a2dd6c905f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.127396 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb86a180ac94396ae3f06a2dd6c905f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.128060 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb86a180ac94396ae3f06a2dd6c905f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.131088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:34.131374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:34.141048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:34.141198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb86a180ac94396ae3f06a2dd6c905f'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.153296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] MFA Rules not processed for user `414890c69e094fc18793259e8c34a70b`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:34.154532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.157804 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1384/2760] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:33 2022] DELETE /identity/v3/users/0eb86a180ac94396ae3f06a2dd6c905f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:34.212106 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1377/2761] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 02:59:34.226972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:34.228714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.303562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35f8ab-d3cb-43c6-af59-9c71f2e5ff56 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:34.309205 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:34.309831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:34.310113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:34.310381 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:34.312213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.384359 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:34.386037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:34.391110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:34.396134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1385/2762] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:59:34.592087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:34.593537 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.611690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da598c9-6e06-426e-abc2-0d38c2d0991f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:34.631972 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:34.633353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.673734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:34.674367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:34.674695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:34.674979 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] PATH_INFO: `/v3/projects/40395e85497e49bcb3cc7e33ae593a6f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:34.677959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40395e85497e49bcb3cc7e33ae593a6f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:34.680143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:34.692731 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b28f1-05d9-4304-af41-64442fe36bbc service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:34.696259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:34.697037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:34.697626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:34.697626 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:34.699331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:34.709806 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:34.711266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:34.720622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1386/2763] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 02:59:34.859776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40395e85497e49bcb3cc7e33ae593a6f', 'request_id': 'req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.866049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40395e85497e49bcb3cc7e33ae593a6f', 'request_id': 'req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.869729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:34.983415 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40395e85497e49bcb3cc7e33ae593a6f', 'request_id': 'req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.995622 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] The token cache is being invalidate because project 40395e85497e49bcb3cc7e33ae593a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:34.995925 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.996546 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:34.998016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1378/2764] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:34 2022] DELETE /identity/v3/projects/40395e85497e49bcb3cc7e33ae593a6f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:35.002153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:35.014169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21013a87-5a97-4baa-95a5-616264d06808 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:35.070830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:35.071459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:35.071737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:35.072007 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] PATH_INFO: `/v3/users/13de8a04619841b1a2f12310d7c39ee5` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:35.073274 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] RBAC: Authorizing `identity:delete_user(user_id=13de8a04619841b1a2f12310d7c39ee5)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:35.075245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:35.277734 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13de8a04619841b1a2f12310d7c39ee5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:35.372114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13de8a04619841b1a2f12310d7c39ee5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:35.372738 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13de8a04619841b1a2f12310d7c39ee5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:35.373346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13de8a04619841b1a2f12310d7c39ee5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:35.381758 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-d6dbb179-9b9e-470b-a1b0-9a0fdde5ebae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13de8a04619841b1a2f12310d7c39ee5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:35.399353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1387/2765] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:35 2022] DELETE /identity/v3/users/13de8a04619841b1a2f12310d7c39ee5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:35.780117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:35.781731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:35.814312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34de6e6-3e42-4e2b-bcd1-f95f70b0a936 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:35.873746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:35.874385 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:35.874691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:35.874956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] PATH_INFO: `/v3/projects/a1dbf3d0b92b493ea186f0a3be6e685c` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:35.876057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1dbf3d0b92b493ea186f0a3be6e685c)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:35.878024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:35.972429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1dbf3d0b92b493ea186f0a3be6e685c', 'request_id': 'req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:35.978820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1dbf3d0b92b493ea186f0a3be6e685c', 'request_id': 'req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:36.074906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1dbf3d0b92b493ea186f0a3be6e685c', 'request_id': 'req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:36.086656 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] The token cache is being invalidate because project a1dbf3d0b92b493ea186f0a3be6e685c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:36.086946 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:36.087590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-7a94784d-3a51-4f09-a5f6-b5f70612bf6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:36.089070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1379/2766] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:35 2022] DELETE /identity/v3/projects/a1dbf3d0b92b493ea186f0a3be6e685c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:36.095894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.096358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.096461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.116301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:36.117484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:36.134486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:36.182386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1388/2767] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:36.183992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.194793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.195101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.216435 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:36.217650 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:36.226417 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1380/2768] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:36.230671 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.241526 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a6e1-e461-4345-a1d9-4b99ef9251f4 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.246637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.247251 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.247534 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.247809 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.248493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:59:36.248805 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.250478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.266777 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1389/2769] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:59:36.268707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.279400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8339f5-ceaa-46e0-bf2c-8db47a1dd68f None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.285087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.286278 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.291413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.291413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.291413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.291413 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.391034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1381/2770] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:36 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 02:59:36.395335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.405278 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaea87-20e8-42e1-ad11-01c0d3e3d757 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.464590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.465202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.465485 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.465761 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.466389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.468333 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.585121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1390/2771] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:36 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:36.589296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.600212 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b6b98-2b5e-4cd9-8422-41b925091252 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.604969 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.605654 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.606056 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.606335 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.607021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.609296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.619906 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1382/2772] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:36.624822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.635403 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eaac3-5717-4f40-bf53-1aea2d375ca6 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.640199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afff18-55b6-4c94-9e5e-10ca0f23104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.640796 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afff18-55b6-4c94-9e5e-10ca0f23104c admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.641142 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afff18-55b6-4c94-9e5e-10ca0f23104c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.641349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afff18-55b6-4c94-9e5e-10ca0f23104c admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.642020 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afff18-55b6-4c94-9e5e-10ca0f23104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.643644 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afff18-55b6-4c94-9e5e-10ca0f23104c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.655448 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1391/2773] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:36.659629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.670674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222e0e-d0f3-405a-9bc0-615c00751c84 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.675188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.675824 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.676215 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.676675 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] PATH_INFO: `/v3/projects/4f5e1e2afaeb4a878389b2f985f04bf8/users/f404913d7f0d406cbc840bd585e30260/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.691085 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5e1e2afaeb4a878389b2f985f04bf8, user_id=f404913d7f0d406cbc840bd585e30260, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.694083 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.796123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1383/2774] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:36 2022] PUT /identity/v3/projects/4f5e1e2afaeb4a878389b2f985f04bf8/users/f404913d7f0d406cbc840bd585e30260/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:36.808643 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.808921 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.809198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.837109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] MFA Rules not processed for user `f404913d7f0d406cbc840bd585e30260`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:36.838327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:36.903374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1392/2775] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:36.915602 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:36.917285 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:36.931985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:36.975235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1ba58-d463-43d0-b680-d13f02f382dc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:36.979027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:36.979626 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:36.979904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:36.980179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:36.989105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:36.990561 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:36.999347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1384/2776] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:46.900372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:47.024289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=20 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:50.339227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:50.340677 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:50.396057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a68b93-6bda-412b-9e18-994950f292a3 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:50.400259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:50.400851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:50.401125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:50.401389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:50.403117 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:50.465265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:50.466787 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263db52a-9df5-431b-9042-ba42954e764d service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:50.476371 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1393/2777] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:53.459412 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:53.529648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b08827-9f7e-46e9-90c1-37b87e6ed98a service glance] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:53.534765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:53.536591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:53.536591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:53.536591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] PATH_INFO: `/v3/users/f404913d7f0d406cbc840bd585e30260` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:53.537225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f404913d7f0d406cbc840bd585e30260)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:53.539832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:53.759802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f404913d7f0d406cbc840bd585e30260'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:53.760408 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f404913d7f0d406cbc840bd585e30260'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:53.829487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f404913d7f0d406cbc840bd585e30260'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:53.830111 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f404913d7f0d406cbc840bd585e30260'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:53.843898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f404913d7f0d406cbc840bd585e30260'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:53.857239 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1385/2778] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 02:59:53 2022] DELETE /identity/v3/users/f404913d7f0d406cbc840bd585e30260 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:53.861680 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:53.862158 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:53.862259 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:53.881181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:53.882419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:53.945789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1394/2779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:53.955760 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:53.959317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:54.017156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073fac-0c0a-45c4-82fb-6e2628f6d8fc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:54.021032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce04ce-fc23-4824-9d28-5804b4ff2757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:54.023351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce04ce-fc23-4824-9d28-5804b4ff2757 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:54.023351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce04ce-fc23-4824-9d28-5804b4ff2757 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:54.023351 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce04ce-fc23-4824-9d28-5804b4ff2757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:54.031658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce04ce-fc23-4824-9d28-5804b4ff2757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:54.033082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce04ce-fc23-4824-9d28-5804b4ff2757 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:54.042586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1386/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:54.436609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:54.438113 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:54.453308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ffff8-55c9-40cb-a47b-e7986a955d41 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:54.458159 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:54.458830 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:54.460279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:54.460279 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] PATH_INFO: `/v3/projects/4f5e1e2afaeb4a878389b2f985f04bf8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:54.460509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5e1e2afaeb4a878389b2f985f04bf8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:54.463500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:54.558747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:54.561344 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5e1e2afaeb4a878389b2f985f04bf8', 'request_id': 'req-f7f8270b-85bc-4553-9d23-c825b4fe89fb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:54.567509 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5e1e2afaeb4a878389b2f985f04bf8', 'request_id': 'req-f7f8270b-85bc-4553-9d23-c825b4fe89fb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:54.646429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5e1e2afaeb4a878389b2f985f04bf8', 'request_id': 'req-f7f8270b-85bc-4553-9d23-c825b4fe89fb'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:54.659089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] The token cache is being invalidate because project 4f5e1e2afaeb4a878389b2f985f04bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 02:59:54.659433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:54.660101 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f7f8270b-85bc-4553-9d23-c825b4fe89fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 02:59:54.661651 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1395/2781] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 02:59:54 2022] DELETE /identity/v3/projects/4f5e1e2afaeb4a878389b2f985f04bf8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:54.666940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:54.667430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:54.667538 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:54.688030 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:54.689371 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:54.707965 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:54.750264 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1387/2782] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:54.758609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:54.758896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:54.759319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:54.779051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:54.780249 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:54.788127 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1396/2783] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:54.792326 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:54.802098 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f327c-7700-45d2-9899-7304dec31c3e None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:54.807457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:54.808049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:54.808328 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:54.808595 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:54.809303 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 02:59:54.809591 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:54.811227 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:54.823914 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1388/2784] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 02:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 02:59:54.828374 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:54.837747 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df71bb6-efec-431b-ae4a-4df9f8eb2c81 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:54.842498 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:54.843103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:54.843384 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:54.843676 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:54.844318 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:54.846206 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:54.951072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1397/2785] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:54 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:54.955456 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:54.965734 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5286-b582-486a-b2f4-42bed41cfacd admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.022940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.023527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.023868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.024222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.024963 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.026990 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.110420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1389/2786] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:54 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:55.114527 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.126002 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ce4cc-36e0-411d-9e7f-c13dc0ffb4ad admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.131100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.131699 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.131979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.132254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.132980 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.134720 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.144881 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1398/2787] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:59:55.149140 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.159114 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c75bd-874e-46f5-93a6-e0b651716401 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.163942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9051c-2091-4cf8-9605-47874f87e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.165298 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9051c-2091-4cf8-9605-47874f87e32b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.166167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9051c-2091-4cf8-9605-47874f87e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.166167 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9051c-2091-4cf8-9605-47874f87e32b admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.166515 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9051c-2091-4cf8-9605-47874f87e32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.168104 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9051c-2091-4cf8-9605-47874f87e32b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.179496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1390/2788] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:55.185145 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.195260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aa8bc-b961-441a-b7d7-95f8c15a7852 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.200174 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.200849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.201124 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.201394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] PATH_INFO: `/v3/projects/7b461198eb29487b92edf19f20f883c7/users/a494c6c0330647c397818c095d64e0d5/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.216444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b461198eb29487b92edf19f20f883c7, user_id=a494c6c0330647c397818c095d64e0d5, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.219131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.263489 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1399/2789] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:55 2022] PUT /identity/v3/projects/7b461198eb29487b92edf19f20f883c7/users/a494c6c0330647c397818c095d64e0d5/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:55.274330 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.274659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.274940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.303294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] MFA Rules not processed for user `a494c6c0330647c397818c095d64e0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:55.304505 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:55.370960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1391/2790] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:55.375386 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.437971 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cceb67-65ae-4c41-a4fb-caae160f5b94 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.442773 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.443373 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.443656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.443930 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.444552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.447077 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.547703 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1400/2791] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:55 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:55.552316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.563271 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fa3bc-df76-4f1a-ae7f-5a8f0090e025 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.576279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:55.622213 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.622806 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.623084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.623355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.623999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.626230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.716617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1392/2792] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:55 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:55.720719 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.731308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d117178-d0dd-4501-95d2-8a7abfe0eedd admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.736069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.736668 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.736947 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.737218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.737856 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.739466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.750248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1401/2793] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:55.754333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.764934 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499b773-b2dc-4aed-9ee2-53a8b961b61b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.769461 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4b2f4-378d-4c53-a05c-357c72d93892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.770073 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4b2f4-378d-4c53-a05c-357c72d93892 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.770346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4b2f4-378d-4c53-a05c-357c72d93892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.770646 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4b2f4-378d-4c53-a05c-357c72d93892 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.771277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4b2f4-378d-4c53-a05c-357c72d93892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.772840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4b2f4-378d-4c53-a05c-357c72d93892 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.783517 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1393/2794] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:55.787698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:55.798311 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de114-d502-425d-8a5d-fa6f50302316 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:55.803065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:55.803708 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.803985 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.804254 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] PATH_INFO: `/v3/projects/a2479a29c86647aab7235f7d3aeb872f/users/8dfdf05ef8da4e47bde80218899ee2d8/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.818698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2479a29c86647aab7235f7d3aeb872f, user_id=8dfdf05ef8da4e47bde80218899ee2d8, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:55.822024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:55.905047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1402/2795] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:55 2022] PUT /identity/v3/projects/a2479a29c86647aab7235f7d3aeb872f/users/8dfdf05ef8da4e47bde80218899ee2d8/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:55.916606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:55.916893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:55.917170 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:55.944817 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] MFA Rules not processed for user `8dfdf05ef8da4e47bde80218899ee2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:55.946776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:56.012698 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1394/2796] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:56.017570 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.039595 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:56.082037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c233e9-1953-4a4c-ad31-73010f05b332 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.087402 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.088017 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.088289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.088555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.089181 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.091467 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.150015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1403/2797] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 02:59:56 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:56.154230 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.164876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c92bde-e451-409e-9454-94cb7c918744 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.220209 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.220803 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.221078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.221346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.221966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.223900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.297790 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1395/2798] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 02:59:56 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 02:59:56.301891 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.312688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c6824-3585-40cd-b27a-72ce4d66e885 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.317355 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.317941 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.318224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.318518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.319155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.321505 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.332005 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1404/2799] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 02:59:56.341145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.351128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9def7-ba72-4da2-8fdc-82ecf768e86c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.355983 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.356635 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.356900 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.357169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] PATH_INFO: `/v3/projects/c8bf4009864e4963a3887b47fda1f870/users/8e6d60b3619a49c8be405909598e6a6c/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.370903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:56.373852 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bf4009864e4963a3887b47fda1f870, user_id=8e6d60b3619a49c8be405909598e6a6c, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.376519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.423434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1396/2800] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:56 2022] PUT /identity/v3/projects/c8bf4009864e4963a3887b47fda1f870/users/8e6d60b3619a49c8be405909598e6a6c/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 02:59:56.427460 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.438227 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec227-52a9-4176-85b1-f177798d6767 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.494519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226ab3c-408f-4b61-a76d-77a948e6ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.495123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ab3c-408f-4b61-a76d-77a948e6ad70 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.495466 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ab3c-408f-4b61-a76d-77a948e6ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.495736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ab3c-408f-4b61-a76d-77a948e6ad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.496370 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226ab3c-408f-4b61-a76d-77a948e6ad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.497940 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226ab3c-408f-4b61-a76d-77a948e6ad70 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.507541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1405/2801] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 02:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 02:59:56.512069 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.522097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554ec7-c39a-4e7a-8fde-a5ca3780b77f admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.526950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.527587 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.527862 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.528134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] PATH_INFO: `/v3/projects/c8bf4009864e4963a3887b47fda1f870/users/8e6d60b3619a49c8be405909598e6a6c/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.530002 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bf4009864e4963a3887b47fda1f870, user_id=8e6d60b3619a49c8be405909598e6a6c, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.532647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.543396 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1397/2802] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 02:59:56 2022] PUT /identity/v3/projects/c8bf4009864e4963a3887b47fda1f870/users/8e6d60b3619a49c8be405909598e6a6c/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 02:59:56.554431 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.554989 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.555268 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.587382 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] MFA Rules not processed for user `8e6d60b3619a49c8be405909598e6a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 02:59:56.588584 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:56.663495 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1406/2803] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 02:59:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 02:59:56.675300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:56.676927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 02:59:56.740041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97b5f2-b469-42c4-bb53-42e9a6408552 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:56.744322 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:56.744921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:56.745195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:56.745463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:56.803674 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:56.805957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:56.815197 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1398/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 02:59:58.656242 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 02:59:58.667076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb93af-0850-484c-982c-889910d71e45 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 02:59:58.670905 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 02:59:58.671501 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 02:59:58.671784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 02:59:58.672057 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 02:59:58.686285 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 02:59:58.740032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 02:59:58.741469 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 02:59:58.751185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1407/2805] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 02:59:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 03:00:00.172827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:00.172827 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:00.183972 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04275ed1-92fe-4fa3-8a3b-ca8528834455 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:00.187556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47a5d6-b3ed-4d34-accb-6bdf80002874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:00.188153 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a5d6-b3ed-4d34-accb-6bdf80002874 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:00.188423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a5d6-b3ed-4d34-accb-6bdf80002874 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:00.188690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47a5d6-b3ed-4d34-accb-6bdf80002874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:00.197833 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a5d6-b3ed-4d34-accb-6bdf80002874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:00.199338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47a5d6-b3ed-4d34-accb-6bdf80002874 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:00.208657 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1399/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:04.849331 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:04.914377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66bea3-fbb2-478d-8289-e7af09a65cce service cinder] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:04.919441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:04.923100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:04.923100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:04.923100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] PATH_INFO: `/v3/users/a494c6c0330647c397818c095d64e0d5` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:04.923100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a494c6c0330647c397818c095d64e0d5)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:04.923915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:05.111465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a494c6c0330647c397818c095d64e0d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:05.183688 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a494c6c0330647c397818c095d64e0d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:05.184349 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a494c6c0330647c397818c095d64e0d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:05.185016 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a494c6c0330647c397818c095d64e0d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:05.192188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a494c6c0330647c397818c095d64e0d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:05.210061 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1408/2807] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:04 2022] DELETE /identity/v3/users/a494c6c0330647c397818c095d64e0d5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:05.214742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:05.215235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:05.215333 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:05.234498 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:05.235738 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:05.298149 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1400/2808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:05.307723 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:05.309986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:05.346209 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:05.368299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55a93c-afe5-471b-8b73-67060f307ca8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:05.372656 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:05.373258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:05.373538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:05.373811 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:05.382976 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:05.385027 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:05.395300 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1409/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:06.014782 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:06.016469 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:06.029198 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52f54-f848-406d-9c21-92dbc1bd7fa5 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:06.034110 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:06.034787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:06.035070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:06.035340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] PATH_INFO: `/v3/projects/7b461198eb29487b92edf19f20f883c7` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:06.036473 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b461198eb29487b92edf19f20f883c7)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:06.038496 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:06.056389 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:06.127513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b461198eb29487b92edf19f20f883c7', 'request_id': 'req-b7b1b796-a900-4040-9ee2-60760b9bd857'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.133721 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b461198eb29487b92edf19f20f883c7', 'request_id': 'req-b7b1b796-a900-4040-9ee2-60760b9bd857'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.188729 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b461198eb29487b92edf19f20f883c7', 'request_id': 'req-b7b1b796-a900-4040-9ee2-60760b9bd857'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.199847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] The token cache is being invalidate because project 7b461198eb29487b92edf19f20f883c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:06.200228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.200863 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.202402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1401/2810] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:06 2022] DELETE /identity/v3/projects/7b461198eb29487b92edf19f20f883c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:06.206410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:06.216562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d7c2e-a0b3-41a7-91a7-7000a9a6b0b7 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:06.274150 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:06.274726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:06.275048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:06.275280 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] PATH_INFO: `/v3/users/8dfdf05ef8da4e47bde80218899ee2d8` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:06.276709 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfdf05ef8da4e47bde80218899ee2d8)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:06.280018 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:06.444393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfdf05ef8da4e47bde80218899ee2d8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.509025 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfdf05ef8da4e47bde80218899ee2d8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.509653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfdf05ef8da4e47bde80218899ee2d8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.510265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfdf05ef8da4e47bde80218899ee2d8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.517935 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfdf05ef8da4e47bde80218899ee2d8'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:06.536423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1410/2811] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:06 2022] DELETE /identity/v3/users/8dfdf05ef8da4e47bde80218899ee2d8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:06.934317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:06.935787 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:06.948868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b796-a900-4040-9ee2-60760b9bd857 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:07.007135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:07.007761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:07.008040 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:07.008313 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] PATH_INFO: `/v3/projects/a2479a29c86647aab7235f7d3aeb872f` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:07.009487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2479a29c86647aab7235f7d3aeb872f)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:07.011671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:07.107752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2479a29c86647aab7235f7d3aeb872f', 'request_id': 'req-98ca9d09-ac90-41ce-b909-6840183b156d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.114640 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2479a29c86647aab7235f7d3aeb872f', 'request_id': 'req-98ca9d09-ac90-41ce-b909-6840183b156d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.189280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2479a29c86647aab7235f7d3aeb872f', 'request_id': 'req-98ca9d09-ac90-41ce-b909-6840183b156d'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.200876 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] The token cache is being invalidate because project a2479a29c86647aab7235f7d3aeb872f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:07.201162 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.201791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.203304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1402/2812] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:06 2022] DELETE /identity/v3/projects/a2479a29c86647aab7235f7d3aeb872f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:07.207520 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:07.208938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:07.222493 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42519-b030-4cf5-8082-0fc148621b92 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:07.275916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:07.283191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:07.283817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:07.284095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:07.284413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] PATH_INFO: `/v3/users/8e6d60b3619a49c8be405909598e6a6c` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:07.285659 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6d60b3619a49c8be405909598e6a6c)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:07.287617 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:07.431915 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6d60b3619a49c8be405909598e6a6c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.498392 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6d60b3619a49c8be405909598e6a6c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.499038 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6d60b3619a49c8be405909598e6a6c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.499665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6d60b3619a49c8be405909598e6a6c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.507523 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-ffeb0a44-d297-4673-b84d-8590a7c10ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6d60b3619a49c8be405909598e6a6c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:07.527784 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1411/2813] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:07 2022] DELETE /identity/v3/users/8e6d60b3619a49c8be405909598e6a6c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:07.945358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:07.946822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:07.960544 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca9d09-ac90-41ce-b909-6840183b156d admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:07.993742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:08.021269 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.021942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.022225 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.022520 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] PATH_INFO: `/v3/projects/c8bf4009864e4963a3887b47fda1f870` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.023624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bf4009864e4963a3887b47fda1f870)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:08.025552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:08.137420 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bf4009864e4963a3887b47fda1f870', 'request_id': 'req-a544213e-c3e3-4ed7-83a1-0ccb577919eb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:08.144142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bf4009864e4963a3887b47fda1f870', 'request_id': 'req-a544213e-c3e3-4ed7-83a1-0ccb577919eb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:08.206048 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bf4009864e4963a3887b47fda1f870', 'request_id': 'req-a544213e-c3e3-4ed7-83a1-0ccb577919eb'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:08.218458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] The token cache is being invalidate because project c8bf4009864e4963a3887b47fda1f870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:08.218777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:08.219402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a544213e-c3e3-4ed7-83a1-0ccb577919eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:08.220890 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1403/2814] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:07 2022] DELETE /identity/v3/projects/c8bf4009864e4963a3887b47fda1f870 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:08.225837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.226571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.226571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.247191 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:08.248458 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:08.306112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1412/2815] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:08.314096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.314457 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.314850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.334950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:08.336152 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:08.344745 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1404/2816] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:08.348808 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:08.358846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddc545-1c05-4f42-b6c4-28c699bfff4a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:08.363385 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.363970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.364265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.364535 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.365163 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 03:00:08.365461 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:08.367069 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:08.378379 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1413/2817] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 03:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 03:00:08.384093 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:08.393805 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c4a80-40bb-45a1-832a-e9f69df787a2 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:08.398623 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.399211 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.399508 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.399761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.400430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:08.402947 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:08.517617 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1405/2818] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:08 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:08.521983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:08.533075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1010a-a003-4028-a0f6-4f37fc13e917 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:08.593785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.594409 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.594736 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.595006 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.595684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:08.597562 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:08.606795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:08.901718 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1414/2819] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:08 2022] POST /identity/v3/users => generated 288 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 03:00:08.903126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:08.915778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e1d05-38f7-4380-b2da-df877e39faa9 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:08.919129 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.919730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.920008 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.920277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.921184 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:08.922871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:08.934755 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1406/2820] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:08.938991 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:08.949615 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac0d7e-8f51-4454-8ec7-bd01cf822e91 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:08.956104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0bca6-61b3-45d7-871f-c375f66ac976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.956104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0bca6-61b3-45d7-871f-c375f66ac976 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.956104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0bca6-61b3-45d7-871f-c375f66ac976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.956104 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0bca6-61b3-45d7-871f-c375f66ac976 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:08.956669 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0bca6-61b3-45d7-871f-c375f66ac976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:08.957918 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0bca6-61b3-45d7-871f-c375f66ac976 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:08.969075 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1415/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:08.975711 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:08.986108 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce626b-980a-442c-99c2-b980afa1371a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:08.990821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:08.991472 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:08.991746 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:08.992013 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] PATH_INFO: `/v3/projects/679b3f24bb264a29aab444ae1e2c3db4/users/bf719f18c31a4430a8cb273a677533e3/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:09.007487 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b3f24bb264a29aab444ae1e2c3db4, user_id=bf719f18c31a4430a8cb273a677533e3, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:09.010134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:09.062992 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1407/2822] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:08 2022] PUT /identity/v3/projects/679b3f24bb264a29aab444ae1e2c3db4/users/bf719f18c31a4430a8cb273a677533e3/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:09.080438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497367c1-e471-4e16-8250-1495863c4310 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:09.080812 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497367c1-e471-4e16-8250-1495863c4310 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:09.081155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497367c1-e471-4e16-8250-1495863c4310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:09.110774 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-497367c1-e471-4e16-8250-1495863c4310 None None] MFA Rules not processed for user `bf719f18c31a4430a8cb273a677533e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:09.116121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-497367c1-e471-4e16-8250-1495863c4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:09.179410 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1416/2823] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:09.189849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:09.191691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:09.249484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976336b2-bd1b-43e2-b753-f1bf0ede167c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:09.253247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:09.253855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:09.254131 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:09.254401 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:09.263884 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:09.265342 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:09.273987 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1408/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:13.342825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497367c1-e471-4e16-8250-1495863c4310 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:13.344288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-497367c1-e471-4e16-8250-1495863c4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:13.443698 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497367c1-e471-4e16-8250-1495863c4310 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:13.449973 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:13.450684 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:13.450961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:13.451226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:13.453024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:13.464597 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:13.466304 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:13.476269 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1417/2825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:13.517255 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:13.518921 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:13.524283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:13.587337 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9e52-c593-499e-9d46-4c2a599bf243 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:13.592321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:13.592955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:13.593235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:13.593507 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] PATH_INFO: `/v3/users/414890c69e094fc18793259e8c34a70b` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:13.594849 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414890c69e094fc18793259e8c34a70b)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:13.596768 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:13.768928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414890c69e094fc18793259e8c34a70b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:13.769503 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414890c69e094fc18793259e8c34a70b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:13.840740 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414890c69e094fc18793259e8c34a70b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:13.841553 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414890c69e094fc18793259e8c34a70b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:13.854094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414890c69e094fc18793259e8c34a70b'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:13.866431 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1409/2826] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:13 2022] DELETE /identity/v3/users/414890c69e094fc18793259e8c34a70b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:14.122545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:14.135169 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c3b59-0300-415d-ad3c-117f8cee9503 service placement] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:14.175338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:14.193798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:14.194532 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:14.194817 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:14.195089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] PATH_INFO: `/v3/projects/c80503fc3e2c4b9eb236827625874578` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:14.196198 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80503fc3e2c4b9eb236827625874578)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:14.198130 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:14.333638 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80503fc3e2c4b9eb236827625874578', 'request_id': 'req-b86853b6-63e4-4254-9711-059d0655ec83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.340459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80503fc3e2c4b9eb236827625874578', 'request_id': 'req-b86853b6-63e4-4254-9711-059d0655ec83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.418694 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80503fc3e2c4b9eb236827625874578', 'request_id': 'req-b86853b6-63e4-4254-9711-059d0655ec83'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.427010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] The token cache is being invalidate because project c80503fc3e2c4b9eb236827625874578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:14.427551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.428204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.429996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1418/2827] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:14 2022] DELETE /identity/v3/projects/c80503fc3e2c4b9eb236827625874578 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:14.434709 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:14.436242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:14.449188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcd491-2f63-4960-822c-6e09f4f27d35 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:14.508772 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:14.509582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:14.509692 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:14.509916 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] PATH_INFO: `/v3/users/81094dd0e9504bcc97f3f3f2f790e0a1` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:14.511087 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81094dd0e9504bcc97f3f3f2f790e0a1)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:14.513886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:14.538514 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:14.660922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81094dd0e9504bcc97f3f3f2f790e0a1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.661613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81094dd0e9504bcc97f3f3f2f790e0a1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.705097 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81094dd0e9504bcc97f3f3f2f790e0a1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.705715 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81094dd0e9504bcc97f3f3f2f790e0a1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.719653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-5add0925-addc-44ad-94bb-1e97ae34634e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81094dd0e9504bcc97f3f3f2f790e0a1'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:14.733199 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1410/2828] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:14 2022] DELETE /identity/v3/users/81094dd0e9504bcc97f3f3f2f790e0a1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:14.946193 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:14.947776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:14.970229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86853b6-63e4-4254-9711-059d0655ec83 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.038757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.039400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.039683 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.039960 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] PATH_INFO: `/v3/projects/e42ec9f047ec48dbac9fee4214f03e59` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.041099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42ec9f047ec48dbac9fee4214f03e59)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.043609 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.148587 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42ec9f047ec48dbac9fee4214f03e59', 'request_id': 'req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:15.155963 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42ec9f047ec48dbac9fee4214f03e59', 'request_id': 'req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:15.223404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42ec9f047ec48dbac9fee4214f03e59', 'request_id': 'req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:15.238291 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:15.244139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] The token cache is being invalidate because project e42ec9f047ec48dbac9fee4214f03e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:15.244358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:15.245037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-7a81eeb1-1af5-4981-b1f4-74c2c3fef8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:15.247353 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1419/2829] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:14 2022] DELETE /identity/v3/projects/e42ec9f047ec48dbac9fee4214f03e59 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:15.255474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.255756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.256057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.282252 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:15.283653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:15.360651 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1411/2830] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:15.370488 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.371692 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.372357 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.396939 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:15.398215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:15.408732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1420/2831] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:15.414854 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:15.425463 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746bba6-b07b-4198-aeaa-fc355dfa9fbd None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.430527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.431210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.431552 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.431886 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.432853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 03:00:15.434137 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.437705 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.455996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1412/2832] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 03:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 03:00:15.460631 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:15.470751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d1b58-935f-45d8-af34-03958d627e5f None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.477284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.477995 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.479276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.479276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.479276 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.481637 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.604558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1421/2833] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:15 2022] POST /identity/v3/projects => generated 359 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:15.609785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:15.622294 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af199a0c-0fe9-4885-9e71-e8fafc356513 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.684216 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.684882 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.685256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.685529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.686168 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.688647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.777261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1413/2834] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:15 2022] POST /identity/v3/users => generated 280 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:15.779345 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:15.791356 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529efa13-cf6d-41cd-840a-3c4af209e2b3 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.797660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.798271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.798581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.798858 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.799516 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.801110 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.814779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1422/2835] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:15.818877 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:15.832624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a9d6b-7aa1-4886-8240-f92e69f5a9e7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.837427 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cea29e-1750-4225-a895-c1758a1ae646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.838032 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cea29e-1750-4225-a895-c1758a1ae646 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.839266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cea29e-1750-4225-a895-c1758a1ae646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.839266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cea29e-1750-4225-a895-c1758a1ae646 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.839266 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cea29e-1750-4225-a895-c1758a1ae646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.841888 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cea29e-1750-4225-a895-c1758a1ae646 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.854084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1414/2836] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:15.859670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:15.870863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b29ef-2857-4525-9665-3c74618cdeb4 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:15.876297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:15.876959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.877240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.877515 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] PATH_INFO: `/v3/projects/1e0f9daa8a96473683c2c07965bfa404/users/17e4d15588ae4711ace189a03d3e48a6/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:15.898998 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0f9daa8a96473683c2c07965bfa404, user_id=17e4d15588ae4711ace189a03d3e48a6, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:15.901794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:15.977518 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1423/2837] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:15 2022] PUT /identity/v3/projects/1e0f9daa8a96473683c2c07965bfa404/users/17e4d15588ae4711ace189a03d3e48a6/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:15.989840 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:15.990126 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:15.990446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:16.005855 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:16.023898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] MFA Rules not processed for user `17e4d15588ae4711ace189a03d3e48a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:16.025091 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:16.104500 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1415/2838] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:16.145405 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:16.150105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:16.206200 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27d78-6b50-4b4d-af2a-8dbd822c244a admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:16.209901 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea49e-9e70-448a-8ac1-2c320b94fca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:16.210546 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea49e-9e70-448a-8ac1-2c320b94fca1 service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:16.210832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea49e-9e70-448a-8ac1-2c320b94fca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:16.211188 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea49e-9e70-448a-8ac1-2c320b94fca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:16.220354 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea49e-9e70-448a-8ac1-2c320b94fca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:16.221793 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea49e-9e70-448a-8ac1-2c320b94fca1 service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:16.231878 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1424/2839] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:16.247668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:16.310304 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74025d-f375-45c5-98d7-a0d3ff179446 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:16.315242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:16.315872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:16.316171 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:16.316570 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] PATH_INFO: `/v3/users/17e4d15588ae4711ace189a03d3e48a6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:16.317950 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e4d15588ae4711ace189a03d3e48a6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:16.319677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:16.537638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e4d15588ae4711ace189a03d3e48a6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:16.538321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e4d15588ae4711ace189a03d3e48a6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:16.600606 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e4d15588ae4711ace189a03d3e48a6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:16.601346 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e4d15588ae4711ace189a03d3e48a6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:16.622670 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e4d15588ae4711ace189a03d3e48a6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:16.628501 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1416/2840] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:16 2022] DELETE /identity/v3/users/17e4d15588ae4711ace189a03d3e48a6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:16.632957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:16.633399 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:16.633623 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:16.653663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:16.654954 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:16.722360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1425/2841] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:16.732695 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:16.734041 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:16.753070 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:16.794607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203ed5c-a933-4d7b-a6d5-15cc519c70e2 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:16.798634 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcca119-da58-4640-80ba-6b88f836e065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:16.799235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca119-da58-4640-80ba-6b88f836e065 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:16.799513 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca119-da58-4640-80ba-6b88f836e065 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:16.799780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca119-da58-4640-80ba-6b88f836e065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:16.809325 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcca119-da58-4640-80ba-6b88f836e065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:16.810879 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcca119-da58-4640-80ba-6b88f836e065 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:16.822724 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1417/2842] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:17.220125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.221601 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:17.234365 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b4b36-37db-482b-ac39-9aa5b1d578bd None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.239232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.239861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.240143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.240979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] PATH_INFO: `/v3/projects/1e0f9daa8a96473683c2c07965bfa404` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.241537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0f9daa8a96473683c2c07965bfa404)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.243486 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:17.351798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:17.361737 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0f9daa8a96473683c2c07965bfa404', 'request_id': 'req-8b17e969-a497-4625-b60c-fc388fc60589'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:17.367873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0f9daa8a96473683c2c07965bfa404', 'request_id': 'req-8b17e969-a497-4625-b60c-fc388fc60589'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:17.434899 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0f9daa8a96473683c2c07965bfa404', 'request_id': 'req-8b17e969-a497-4625-b60c-fc388fc60589'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:17.445756 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] The token cache is being invalidate because project 1e0f9daa8a96473683c2c07965bfa404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:17.446044 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:17.446882 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-8b17e969-a497-4625-b60c-fc388fc60589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:17.448232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1426/2843] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:17 2022] DELETE /identity/v3/projects/1e0f9daa8a96473683c2c07965bfa404 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:17.453748 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423d4a-dd07-4704-8684-83500662841b None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.454036 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423d4a-dd07-4704-8684-83500662841b None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.454361 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423d4a-dd07-4704-8684-83500662841b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.476049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ca423d4a-dd07-4704-8684-83500662841b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:17.477248 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ca423d4a-dd07-4704-8684-83500662841b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:17.537258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1418/2844] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:17.546965 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.547312 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.547838 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.567400 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:17.568593 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:17.577454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1427/2845] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:17.581761 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423d4a-dd07-4704-8684-83500662841b None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.592210 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423d4a-dd07-4704-8684-83500662841b None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.597043 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.597653 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.597928 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.598195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.599021 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 03:00:17.599321 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.600912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:17.612619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1419/2846] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 03:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 03:00:17.618263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.628157 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950fc9d-46f7-492e-895f-396c7e0ec685 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.632789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.633415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.633952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.633952 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.634710 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.636580 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:17.715494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1428/2847] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:17 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 03:00:17.719659 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.729627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145d3d-e1ad-4eb1-9cc0-64415fca1f0c admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.786324 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.786944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.787221 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.787541 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.788143 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.790123 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:17.857309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1420/2848] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:17 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:17.864975 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.872753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ea90d-a985-455b-add1-06e522e1a8e2 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.877372 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.877957 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.878232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.878521 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.879153 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.880722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:17.891585 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1429/2849] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:17.895446 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.906112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99c75c-464f-4104-9852-c07af3d0fe7a admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.910731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3318e-86db-42ee-b0f6-b6789e58f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.911317 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3318e-86db-42ee-b0f6-b6789e58f8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.911590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3318e-86db-42ee-b0f6-b6789e58f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.911858 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3318e-86db-42ee-b0f6-b6789e58f8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.912488 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3318e-86db-42ee-b0f6-b6789e58f8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.914052 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3318e-86db-42ee-b0f6-b6789e58f8a8 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:17.925543 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1421/2850] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:17.929663 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:17.939841 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166f7a1-5bf1-40ca-90cc-47f6ab17869f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:17.944441 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:17.945074 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:17.945351 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:17.945622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] PATH_INFO: `/v3/projects/c331960c266d4babacd61448055273b1/users/aa0e128fe6f54b25ba95f9645c7350d5/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:17.959931 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c331960c266d4babacd61448055273b1, user_id=aa0e128fe6f54b25ba95f9645c7350d5, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:17.962575 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.030284 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1430/2851] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:17 2022] PUT /identity/v3/projects/c331960c266d4babacd61448055273b1/users/aa0e128fe6f54b25ba95f9645c7350d5/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:18.040742 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.040961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.041235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.070142 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] MFA Rules not processed for user `aa0e128fe6f54b25ba95f9645c7350d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:18.071372 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:18.085299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:18.143177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1422/2852] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:18.149404 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.210423 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeea21-497f-4031-b573-00bba7216f6f admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.216417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.217024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.217301 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.217572 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.218218 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:18.220144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.312162 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1431/2853] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:18.316228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.330120 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c7fe-89b3-44c7-be55-2f656bf9dcb8 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.385484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.386071 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.386350 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.386689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.387312 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:18.389318 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.481822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1423/2854] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:18 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 03:00:18.485807 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.496618 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688ab9-7989-49ee-9030-368c691a7ca0 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.501435 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.502024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.502297 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.502614 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.503248 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:18.504816 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.517337 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1432/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:18.521555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.532309 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529937-637e-4159-ad16-8821316fe4dc admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.536999 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.537628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.537904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.538172 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] PATH_INFO: `/v3/projects/f024b710250c4c0e9640e34781c95264/users/4b0cd2ed4ea840739f2464147de0d226/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.554224 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024b710250c4c0e9640e34781c95264, user_id=4b0cd2ed4ea840739f2464147de0d226, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:18.556931 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.629188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1424/2856] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:18 2022] PUT /identity/v3/projects/f024b710250c4c0e9640e34781c95264/users/4b0cd2ed4ea840739f2464147de0d226/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 03:00:18.633308 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.643313 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d1d5-aece-4ccc-b0eb-e6200f546341 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.676800 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:18.702319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac4e4a-1044-489d-87f5-6595de4fab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.702961 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4e4a-1044-489d-87f5-6595de4fab03 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.703234 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4e4a-1044-489d-87f5-6595de4fab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.703504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac4e4a-1044-489d-87f5-6595de4fab03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.704131 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4e4a-1044-489d-87f5-6595de4fab03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:18.705686 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac4e4a-1044-489d-87f5-6595de4fab03 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.717032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1433/2857] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:18.721578 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.732763 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1aad8-e1ae-416a-b1ff-3075384a14a1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.737423 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558117a1-138c-4823-9412-022286c97995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.738064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558117a1-138c-4823-9412-022286c97995 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.738344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558117a1-138c-4823-9412-022286c97995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.738664 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558117a1-138c-4823-9412-022286c97995 admin admin] PATH_INFO: `/v3/projects/f024b710250c4c0e9640e34781c95264/users/4b0cd2ed4ea840739f2464147de0d226/roles/71e577fde5844b97bf565dd6010625e6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.740563 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558117a1-138c-4823-9412-022286c97995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024b710250c4c0e9640e34781c95264, user_id=4b0cd2ed4ea840739f2464147de0d226, role_id=71e577fde5844b97bf565dd6010625e6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:18.743281 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558117a1-138c-4823-9412-022286c97995 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:18.754161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1425/2858] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:18 2022] PUT /identity/v3/projects/f024b710250c4c0e9640e34781c95264/users/4b0cd2ed4ea840739f2464147de0d226/roles/71e577fde5844b97bf565dd6010625e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:18.768744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.769032 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.769358 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.798636 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] MFA Rules not processed for user `4b0cd2ed4ea840739f2464147de0d226`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:18.799844 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:18.867452 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1434/2859] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:18.878785 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558117a1-138c-4823-9412-022286c97995 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:18.880649 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-558117a1-138c-4823-9412-022286c97995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:18.941671 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558117a1-138c-4823-9412-022286c97995 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:18.945366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a848c-b80e-4a7d-8019-602b31c8f892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:18.945971 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a848c-b80e-4a7d-8019-602b31c8f892 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:18.946251 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a848c-b80e-4a7d-8019-602b31c8f892 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:18.946679 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a848c-b80e-4a7d-8019-602b31c8f892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:18.966624 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:19.005658 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a848c-b80e-4a7d-8019-602b31c8f892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:19.007151 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a848c-b80e-4a7d-8019-602b31c8f892 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:19.017017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1426/2860] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:20.662628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:20.664048 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:20.728176 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc763c-4f3a-41b3-b204-45213b7b668b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:20.733305 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:20.733552 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:20.733827 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:20.734089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] PATH_INFO: `/v3/users/bf719f18c31a4430a8cb273a677533e3` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:20.735226 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf719f18c31a4430a8cb273a677533e3)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:20.737105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:20.945999 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf719f18c31a4430a8cb273a677533e3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.006258 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf719f18c31a4430a8cb273a677533e3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.006895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf719f18c31a4430a8cb273a677533e3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.007504 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf719f18c31a4430a8cb273a677533e3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.009810 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:21.015837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf719f18c31a4430a8cb273a677533e3'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.036514 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1435/2861] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:20 2022] DELETE /identity/v3/users/bf719f18c31a4430a8cb273a677533e3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:21.038730 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:21.043559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:21.043559 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:21.062155 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:21.063556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:21.129019 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1427/2862] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:21.138908 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:21.140306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:21.198788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ab7e7-3d2c-433e-9081-f6f72f3e59af admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:21.203217 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ee585-97c0-40ea-bc8b-32da528cee60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:21.203865 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ee585-97c0-40ea-bc8b-32da528cee60 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:21.204144 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ee585-97c0-40ea-bc8b-32da528cee60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:21.204415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ee585-97c0-40ea-bc8b-32da528cee60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:21.213551 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ee585-97c0-40ea-bc8b-32da528cee60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:21.215040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ee585-97c0-40ea-bc8b-32da528cee60 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:21.225342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1436/2863] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 03:00:21.614226 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:21.615680 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:21.627956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b26b-4336-472a-be3e-78eb6bab544a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:21.632601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:21.635548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:21.635548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:21.635548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] PATH_INFO: `/v3/projects/679b3f24bb264a29aab444ae1e2c3db4` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:21.635548 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=679b3f24bb264a29aab444ae1e2c3db4)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:21.637096 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:21.744479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679b3f24bb264a29aab444ae1e2c3db4', 'request_id': 'req-2458cc9f-91c2-4769-a8f3-fec60433eb3c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.750789 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679b3f24bb264a29aab444ae1e2c3db4', 'request_id': 'req-2458cc9f-91c2-4769-a8f3-fec60433eb3c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.846367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679b3f24bb264a29aab444ae1e2c3db4', 'request_id': 'req-2458cc9f-91c2-4769-a8f3-fec60433eb3c'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.857613 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] The token cache is being invalidate because project 679b3f24bb264a29aab444ae1e2c3db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:21.857899 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.858608 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-2458cc9f-91c2-4769-a8f3-fec60433eb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:21.860130 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1428/2864] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:21 2022] DELETE /identity/v3/projects/679b3f24bb264a29aab444ae1e2c3db4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:21.865125 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:21.865582 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:21.865831 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:21.889171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:21.890895 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:21.952237 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1437/2865] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:21.960242 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:21.960532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:21.960809 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:21.980953 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:21.982161 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:21.990474 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1429/2866] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:21.994846 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.004497 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1135c3-3bd5-4c3d-8e2b-4985c1b99e82 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.009213 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.011288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.011288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.011288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.011288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 03:00:22.011288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.013539 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.025085 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1438/2867] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 03:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 03:00:22.030054 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.039181 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cdb21-46e7-464f-b499-a82cdacf0281 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.043930 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.044419 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.044684 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.044957 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.045609 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.047783 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.112454 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.114187 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:22.127622 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293d95-7dda-4e21-8954-1fb1e50af9e2 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.132481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.134177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.134177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.134177 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] PATH_INFO: `/v3/users/aa0e128fe6f54b25ba95f9645c7350d5` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.135089 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0e128fe6f54b25ba95f9645c7350d5)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.137114 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.139316 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1430/2868] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:22 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:22.143519 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.161235 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:22.205903 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a94c-d0bd-42d5-b9de-7859015c61d1 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.211034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.211752 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.212037 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.212314 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] PATH_INFO: `/v3/users` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.212939 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.214955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.306628 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0e128fe6f54b25ba95f9645c7350d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:22.315851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1431/2869] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:22 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 03:00:22.321522 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.329370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c09ed2-6ebc-48a0-8904-58bfcd94da8e admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.333940 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.334556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.334820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.335088 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.335713 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.337268 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.347832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1432/2870] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 03:00:22.351436 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.361287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890904ce-c4b1-4a0a-b29f-200e77000512 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.365942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.366511 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.366796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.367064 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.367662 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.369169 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.377425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0e128fe6f54b25ba95f9645c7350d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:22.378204 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0e128fe6f54b25ba95f9645c7350d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:22.378843 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0e128fe6f54b25ba95f9645c7350d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:22.379454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1433/2871] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 03:00:22.383512 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.384161 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:22.385160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:22.387567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-6fe162ec-8ee8-4e1c-8c9b-d0e2937c549b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0e128fe6f54b25ba95f9645c7350d5'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:22.398320 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a952ff-554b-4740-83dc-8b4fcf694e2b admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.403996 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff476bb-a967-4742-9e6c-7bd51d960768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.404997 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff476bb-a967-4742-9e6c-7bd51d960768 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.405276 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff476bb-a967-4742-9e6c-7bd51d960768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.405551 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff476bb-a967-4742-9e6c-7bd51d960768 admin admin] PATH_INFO: `/v3/projects/11ef8ff59b124a1abac92e8665016f13/users/fee45ae313ff41c29b1524ffd0e926af/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.406533 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1439/2872] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:22 2022] DELETE /identity/v3/users/aa0e128fe6f54b25ba95f9645c7350d5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 03:00:22.411103 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.411389 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.411662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.421482 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff476bb-a967-4742-9e6c-7bd51d960768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ef8ff59b124a1abac92e8665016f13, user_id=fee45ae313ff41c29b1524ffd0e926af, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.424479 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff476bb-a967-4742-9e6c-7bd51d960768 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.432045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:22.433240 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:22.494347 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1440/2873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:22.504239 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.505877 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:22.509601 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1434/2874] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:22 2022] PUT /identity/v3/projects/11ef8ff59b124a1abac92e8665016f13/users/fee45ae313ff41c29b1524ffd0e926af/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 03:00:22.516962 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.517302 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.517592 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.537532 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:22.538753 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:22.569949 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888e625-f9ca-4cf6-9fb8-4343423d52de None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.601981 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1435/2875] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:22.611912 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:22.618839 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.619455 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.619735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.620040 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.629759 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.631465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.642948 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1441/2876] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 03:00:22.667985 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e074ac-f24f-42ad-91a2-319329b2d1e3 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:22.672122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:22.672728 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:22.673003 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:22.673274 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:22.682394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:22.683853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:22.693660 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1436/2877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 03:00:23.059558 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:23.061238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:23.077863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cd6bb-faed-4ce1-bedb-cc6d8ee12ddd service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:23.089752 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:23.109010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:23.109010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:23.109010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] PATH_INFO: `/v3/projects/c331960c266d4babacd61448055273b1` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:23.109010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c331960c266d4babacd61448055273b1)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:23.109010 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:23.188222 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:23.202022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c331960c266d4babacd61448055273b1', 'request_id': 'req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.208665 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c331960c266d4babacd61448055273b1', 'request_id': 'req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.264873 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c331960c266d4babacd61448055273b1', 'request_id': 'req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.282581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] The token cache is being invalidate because project c331960c266d4babacd61448055273b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:23.282968 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.283704 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-5e65e08c-7e97-4a04-872a-d9a6fe56b38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.286510 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1442/2878] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:23 2022] DELETE /identity/v3/projects/c331960c266d4babacd61448055273b1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:23.289393 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:23.294764 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:23.300102 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28085248-4d07-409a-8b95-6627023c72b7 service neutron] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:23.363376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:23.364005 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:23.364287 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:23.364560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] PATH_INFO: `/v3/users/4b0cd2ed4ea840739f2464147de0d226` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:23.369243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0cd2ed4ea840739f2464147de0d226)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:23.369243 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:23.597776 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0cd2ed4ea840739f2464147de0d226'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.598354 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0cd2ed4ea840739f2464147de0d226'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.680652 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0cd2ed4ea840739f2464147de0d226'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.681310 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0cd2ed4ea840739f2464147de0d226'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.695347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0cd2ed4ea840739f2464147de0d226'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:23.708736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1437/2879] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:23 2022] DELETE /identity/v3/users/4b0cd2ed4ea840739f2464147de0d226 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 03:00:24.048004 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.048360 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.048753 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.077415 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] MFA Rules not processed for user `fee45ae313ff41c29b1524ffd0e926af`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:24.078714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:24.145757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1443/2880] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:24.146145 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:24.148935 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:24.164393 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:24.166621 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:24.219590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f243b4-bb9a-46a3-a8eb-1e829a18da30 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:24.224193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:24.224818 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.225095 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.225368 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] PATH_INFO: `/v3/projects/f024b710250c4c0e9640e34781c95264` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.226645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f024b710250c4c0e9640e34781c95264)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:24.229725 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:24.235210 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141e996-0496-4f41-b5f7-94ed3736a8d0 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:24.239362 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce1a49-b408-4444-a63f-35ad29e8c03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:24.239996 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce1a49-b408-4444-a63f-35ad29e8c03e service cinder] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.240270 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce1a49-b408-4444-a63f-35ad29e8c03e service cinder] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.240538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce1a49-b408-4444-a63f-35ad29e8c03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.249732 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce1a49-b408-4444-a63f-35ad29e8c03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:24.251185 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce1a49-b408-4444-a63f-35ad29e8c03e service cinder] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:24.255791 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:24.260413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1444/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 03:00:24.349016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f024b710250c4c0e9640e34781c95264', 'request_id': 'req-a62aa7d6-a7e6-413a-8bca-1429136a9c78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:24.355133 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f024b710250c4c0e9640e34781c95264', 'request_id': 'req-a62aa7d6-a7e6-413a-8bca-1429136a9c78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:24.469141 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f024b710250c4c0e9640e34781c95264', 'request_id': 'req-a62aa7d6-a7e6-413a-8bca-1429136a9c78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:24.480136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] The token cache is being invalidate because project f024b710250c4c0e9640e34781c95264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:24.480430 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:24.481066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-a62aa7d6-a7e6-413a-8bca-1429136a9c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:24.483300 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1438/2882] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:24 2022] DELETE /identity/v3/projects/f024b710250c4c0e9640e34781c95264 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 03:00:24.488260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.488545 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.488822 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.508043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:24.509228 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:24.553590 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:24.567366 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1445/2883] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:24.576567 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559def55-cace-49c3-ad80-21a934415578 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.579367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559def55-cace-49c3-ad80-21a934415578 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.579367 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559def55-cace-49c3-ad80-21a934415578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.597409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-559def55-cace-49c3-ad80-21a934415578 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:24.598808 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-559def55-cace-49c3-ad80-21a934415578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:24.607560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1439/2884] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:24.612099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:24.622109 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4599e39-45cb-4c72-9b3b-22afbc014e50 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:24.627314 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:24.627914 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.628190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.628457 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.629100 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 03:00:24.629401 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:24.631028 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:24.643024 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1446/2885] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 03:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 03:00:24.647402 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559def55-cace-49c3-ad80-21a934415578 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:24.657370 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559def55-cace-49c3-ad80-21a934415578 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:24.662306 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:24.663015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.663297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.663582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.664329 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:24.666301 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:24.772926 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1440/2886] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:24 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:24.777202 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:24.791959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03680-0580-45f1-a403-1f5a7c3cb612 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:24.850263 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:24.850916 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.851588 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.852215 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.853482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:24.855634 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:24.956538 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1447/2887] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:24 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:24.958017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:24.972581 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773ebd7-67bf-470b-8e4e-c0dbb3e63cdb admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:24.979028 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:24.979643 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:24.979922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:24.980195 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:24.980913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:24.982582 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:24.998603 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1441/2888] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 03:00:25.001445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:25.011554 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e8f3-9e10-4cee-871e-67f962505636 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:25.016934 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc9fab-b6a8-49a3-95d5-04170a9ea5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:25.017555 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9fab-b6a8-49a3-95d5-04170a9ea5ce admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:25.017837 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9fab-b6a8-49a3-95d5-04170a9ea5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:25.018112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc9fab-b6a8-49a3-95d5-04170a9ea5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:25.018790 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc9fab-b6a8-49a3-95d5-04170a9ea5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:25.020375 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc9fab-b6a8-49a3-95d5-04170a9ea5ce admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:25.031620 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1448/2889] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:25.035736 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:25.046288 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc3661-a524-4b32-ac99-adae3d8e9d89 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:25.051015 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:25.051961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:25.051961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:25.052193 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] PATH_INFO: `/v3/projects/69e15d45cdcc4e21bb15680695899617/users/cf94efc78eaa431ba04c7aa3c29c7e81/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:25.068121 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e15d45cdcc4e21bb15680695899617, user_id=cf94efc78eaa431ba04c7aa3c29c7e81, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:25.070832 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:25.144786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1442/2890] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:25 2022] PUT /identity/v3/projects/69e15d45cdcc4e21bb15680695899617/users/cf94efc78eaa431ba04c7aa3c29c7e81/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 03:00:25.155391 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3989869-b219-404a-91c1-0df11ccc7746 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:25.155900 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3989869-b219-404a-91c1-0df11ccc7746 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:25.156001 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3989869-b219-404a-91c1-0df11ccc7746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:25.184105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c3989869-b219-404a-91c1-0df11ccc7746 None None] MFA Rules not processed for user `cf94efc78eaa431ba04c7aa3c29c7e81`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:25.185832 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c3989869-b219-404a-91c1-0df11ccc7746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:25.250091 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1449/2891] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:25.261867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:25.264259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:25.319529 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f38905-8b1c-4ba2-b8d7-8d45e6f7d681 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:25.323136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:25.323727 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:25.324007 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:25.324279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:25.333405 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:25.334853 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:25.343648 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1443/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:25.976194 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721907f-2548-44a1-9515-fbe85982504a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:25.976487 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721907f-2548-44a1-9515-fbe85982504a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:25.976766 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721907f-2548-44a1-9515-fbe85982504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:25.999350 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-1721907f-2548-44a1-9515-fbe85982504a None None] MFA Rules not processed for user `fee45ae313ff41c29b1524ffd0e926af`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:26.000565 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-1721907f-2548-44a1-9515-fbe85982504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:26.042172 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:26.056123 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1450/2893] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:28.322786 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:28.324176 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:28.376027 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:28.394094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17609-1a50-4153-926a-7ba6b85318fd service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:28.399077 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:28.399681 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:28.399961 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:28.400231 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:28.401967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:28.417807 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:28.420822 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162b95-5eea-4058-9094-3093ad956256 service placement] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:28.436429 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1444/2894] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:36.218229 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=4 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:38.480426 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=9 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:39.830500 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721907f-2548-44a1-9515-fbe85982504a None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:39.897478 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721907f-2548-44a1-9515-fbe85982504a None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:39.903481 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:39.904119 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:39.904394 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:39.904660 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] PATH_INFO: `/v3/users/cf94efc78eaa431ba04c7aa3c29c7e81` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:39.905983 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf94efc78eaa431ba04c7aa3c29c7e81)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:39.908033 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:40.106282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf94efc78eaa431ba04c7aa3c29c7e81'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.160888 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf94efc78eaa431ba04c7aa3c29c7e81'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.161581 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf94efc78eaa431ba04c7aa3c29c7e81'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.162286 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf94efc78eaa431ba04c7aa3c29c7e81'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.170099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf94efc78eaa431ba04c7aa3c29c7e81'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.189459 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1451/2895] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:00:39 2022] DELETE /identity/v3/users/cf94efc78eaa431ba04c7aa3c29c7e81 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:40.194081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:40.194600 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:40.194690 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:40.214063 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:40.215305 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:40.277726 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1445/2896] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:40.287859 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:40.289245 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:40.347413 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867a4dc-00c1-4218-893a-f3c25159b3ee admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:40.350990 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c71b55-bd86-41ef-8dc7-b02c7b629241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:40.351589 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c71b55-bd86-41ef-8dc7-b02c7b629241 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:40.351864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c71b55-bd86-41ef-8dc7-b02c7b629241 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:40.352134 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c71b55-bd86-41ef-8dc7-b02c7b629241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:40.362056 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c71b55-bd86-41ef-8dc7-b02c7b629241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:40.363471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c71b55-bd86-41ef-8dc7-b02c7b629241 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:40.372697 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1452/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:40.756927 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:40.759280 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:40.776778 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d549b-7145-4fe4-bfbf-68ec758856ea None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:40.783223 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:40.783870 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:40.784205 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:40.784509 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] PATH_INFO: `/v3/projects/69e15d45cdcc4e21bb15680695899617` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:40.785630 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e15d45cdcc4e21bb15680695899617)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:40.787590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:40.900366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e15d45cdcc4e21bb15680695899617', 'request_id': 'req-d95f27f3-04c6-444f-81cc-394fcdb41767'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.907639 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e15d45cdcc4e21bb15680695899617', 'request_id': 'req-d95f27f3-04c6-444f-81cc-394fcdb41767'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.972340 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e15d45cdcc4e21bb15680695899617', 'request_id': 'req-d95f27f3-04c6-444f-81cc-394fcdb41767'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.983572 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] The token cache is being invalidate because project 69e15d45cdcc4e21bb15680695899617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:00:40.983959 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.984586 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d95f27f3-04c6-444f-81cc-394fcdb41767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:00:40.986086 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1446/2898] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:00:40 2022] DELETE /identity/v3/projects/69e15d45cdcc4e21bb15680695899617 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:40.991261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:40.991744 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:40.991849 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.011257 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:41.012456 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:41.030099 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:41.077884 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1453/2899] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:00:41.086556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.087358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.087358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.110100 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:41.120480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:41.120480 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1447/2900] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:41.123543 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.135116 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c0863-e88d-450f-bdff-9c0965d04d2b None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.140058 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.143429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.143429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.143429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.143429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 03:00:41.143429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.143920 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.155432 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1454/2901] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Sep 14 03:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 03:00:41.160066 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.168873 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758f064-28d9-4535-81dc-2aa6abc1c2d0 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.174850 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.175454 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.175762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.176034 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.176677 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.178604 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.284344 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1448/2902] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Sep 14 03:00:41 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:41.296788 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.307733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97dcd-db5b-4f80-9fd0-c7c08d33f0f1 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.366152 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.366798 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.367067 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.367338 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.367970 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.369847 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.435368 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1455/2903] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Sep 14 03:00:41 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 03:00:41.439527 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.450135 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13613f67-7432-4438-93dd-c8c57a9aaf49 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.454893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.455483 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.455795 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.456062 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.456691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.458256 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.470540 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1449/2904] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:41.474880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.486212 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8df6-9035-4b2e-9746-d9b1386c50e8 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.490986 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e298-ea7a-4de2-a529-7b80341dee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.491576 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e298-ea7a-4de2-a529-7b80341dee5e admin admin] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.491854 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e298-ea7a-4de2-a529-7b80341dee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.492126 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e298-ea7a-4de2-a529-7b80341dee5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.492764 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214e298-ea7a-4de2-a529-7b80341dee5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.494335 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214e298-ea7a-4de2-a529-7b80341dee5e admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.506397 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1456/2905] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Sep 14 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 03:00:41.511810 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.520893 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c036184-c299-4bff-a91e-8d1c0025ea91 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.525526 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.526160 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.526434 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.526733 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] PATH_INFO: `/v3/projects/2f75d3475b85432dbf3b50683b3f02b3/users/4dd66adaba3742cc93ab0ff4925499a6/roles/bde60ff36c1749398f883222ee4c5e23` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.541872 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f75d3475b85432dbf3b50683b3f02b3, user_id=4dd66adaba3742cc93ab0ff4925499a6, role_id=bde60ff36c1749398f883222ee4c5e23)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.544796 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.636078 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1450/2906] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Sep 14 03:00:41 2022] PUT /identity/v3/projects/2f75d3475b85432dbf3b50683b3f02b3/users/4dd66adaba3742cc93ab0ff4925499a6/roles/bde60ff36c1749398f883222ee4c5e23 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:00:41.702944 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031083e6-d064-488e-8255-8ee8ac789409 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.703238 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031083e6-d064-488e-8255-8ee8ac789409 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.703603 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031083e6-d064-488e-8255-8ee8ac789409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.732465 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-031083e6-d064-488e-8255-8ee8ac789409 None None] MFA Rules not processed for user `4dd66adaba3742cc93ab0ff4925499a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:00:41.736244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-031083e6-d064-488e-8255-8ee8ac789409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:41.802096 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1457/2907] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:00:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:00:41.813666 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:00:41.815406 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:00:41.838848 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:41.879084 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05617c5-76bd-45c2-bee4-3de899b18b96 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:00:41.883105 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27f39b9d908644379d12e3e0b4fc4635', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:00:41.890901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:00:41.890901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:00:41.890901 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:00:41.895689 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:00:41.897156 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:00:41.907576 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1451/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:00:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:00:51.799266 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:00:51.939014 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=17 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:01:05.695216 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801953-5284-48d9-987b-7a5d6b7883e5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:05.695748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801953-5284-48d9-987b-7a5d6b7883e5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:05.695748 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801953-5284-48d9-987b-7a5d6b7883e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:05.716316 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-b7801953-5284-48d9-987b-7a5d6b7883e5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:05.720794 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-b7801953-5284-48d9-987b-7a5d6b7883e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:05.786670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1458/2909] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:05.805128 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:05.806627 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:05.910228 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7f92-496a-4273-9483-5a27eaf91515 service glance] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:05.916291 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:05.916902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:05.917188 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:05.917468 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:05.927756 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:05.929338 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:05.939113 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1452/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:09.818247 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:09.818863 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:09.818974 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:09.841502 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:09.842864 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:09.852199 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1459/2911] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:09.867765 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:09.869275 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:09.884495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a073e-051d-4056-b05b-804d3c949614 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:09.890283 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20259b-6d35-41ba-a9a8-32322d538ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:09.890942 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20259b-6d35-41ba-a9a8-32322d538ecf service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:09.891222 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20259b-6d35-41ba-a9a8-32322d538ecf service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:09.891495 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20259b-6d35-41ba-a9a8-32322d538ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:09.900708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20259b-6d35-41ba-a9a8-32322d538ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:09.902297 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20259b-6d35-41ba-a9a8-32322d538ecf service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:09.916793 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1453/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:12.264912 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:12.276171 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375ffbb-335a-41da-8384-d19d74256336 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:12.281050 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:12.281936 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:12.282219 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:12.282519 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] PATH_INFO: `/v3/users/4dd66adaba3742cc93ab0ff4925499a6` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:12.283791 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd66adaba3742cc93ab0ff4925499a6)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:12.287339 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:12.489797 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd66adaba3742cc93ab0ff4925499a6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:12.555260 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd66adaba3742cc93ab0ff4925499a6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:12.555889 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd66adaba3742cc93ab0ff4925499a6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:12.556494 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd66adaba3742cc93ab0ff4925499a6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:12.564471 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd66adaba3742cc93ab0ff4925499a6'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:12.590327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1460/2913] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:01:12 2022] DELETE /identity/v3/users/4dd66adaba3742cc93ab0ff4925499a6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:01:12.594777 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:12.595260 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:12.595374 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:12.615757 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:12.617122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:12.675347 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1454/2914] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:12.684959 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:12.686380 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:12.743563 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923267c-2fd2-4ce4-b368-038dd2e232a3 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:12.747190 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a195c72-a253-48ae-ad47-13097cd7a4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:12.747789 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195c72-a253-48ae-ad47-13097cd7a4fb service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:12.748062 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195c72-a253-48ae-ad47-13097cd7a4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:12.748330 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195c72-a253-48ae-ad47-13097cd7a4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:12.757156 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a195c72-a253-48ae-ad47-13097cd7a4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:12.758602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a195c72-a253-48ae-ad47-13097cd7a4fb service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:12.767801 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1461/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:13.236820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:13.238259 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:13.250139 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894e7f-4e4c-45f5-b97e-8a9e99ca337a None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:13.256163 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:13.256407 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:13.256682 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:13.256968 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] PATH_INFO: `/v3/projects/2f75d3475b85432dbf3b50683b3f02b3` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:13.258094 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f75d3475b85432dbf3b50683b3f02b3)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:13.260025 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:13.368911 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:01:13.375952 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f75d3475b85432dbf3b50683b3f02b3', 'request_id': 'req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:13.384232 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f75d3475b85432dbf3b50683b3f02b3', 'request_id': 'req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:13.447409 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f75d3475b85432dbf3b50683b3f02b3', 'request_id': 'req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:13.458823 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] The token cache is being invalidate because project 2f75d3475b85432dbf3b50683b3f02b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:01:13.459112 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:13.459815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:01:13.461380 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1455/2916] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:01:13 2022] DELETE /identity/v3/projects/2f75d3475b85432dbf3b50683b3f02b3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:01:14.256567 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d903-01f8-4ab2-9794-de1c8df78dae None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:14.257135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d903-01f8-4ab2-9794-de1c8df78dae None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:14.257135 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d903-01f8-4ab2-9794-de1c8df78dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:14.276955 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-7ee5d903-01f8-4ab2-9794-de1c8df78dae None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:14.281803 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-7ee5d903-01f8-4ab2-9794-de1c8df78dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:14.282571 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:01:14.342289 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1462/2917] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:14.361258 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:14.362577 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:14.442871 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0b1e9-4773-403a-b7fa-ed6b7ef33687 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:14.448455 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:14.449057 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:14.449334 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:14.449607 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:14.457758 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:14.459364 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:14.468821 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1456/2918] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:17.215426 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea2b3-720f-4073-9d92-1464730093b5 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:17.216076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea2b3-720f-4073-9d92-1464730093b5 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:17.216076 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea2b3-720f-4073-9d92-1464730093b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:17.236299 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-e98ea2b3-720f-4073-9d92-1464730093b5 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:17.237482 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e98ea2b3-720f-4073-9d92-1464730093b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:17.246541 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1463/2919] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:17.261956 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:17.273868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ed04-3aa0-4612-ab87-232a41a1dc92 service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:17.279296 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:17.279878 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:17.280154 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:17.280421 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:17.288967 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:17.290557 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:17.300277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1457/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:20.447988 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7910437-9d2d-4e4b-a19a-5dd1c39a061a None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:20.448462 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7910437-9d2d-4e4b-a19a-5dd1c39a061a None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:20.448670 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7910437-9d2d-4e4b-a19a-5dd1c39a061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:20.468757 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-c7910437-9d2d-4e4b-a19a-5dd1c39a061a None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:20.471143 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-c7910437-9d2d-4e4b-a19a-5dd1c39a061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:20.477898 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1464/2921] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:20.531641 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:20.543366 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4198e2-a464-462f-8549-ff0dae803dcb service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:20.549395 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:20.549978 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:20.550254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:20.550556 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:20.559261 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:20.560802 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:20.570081 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1458/2922] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:23.651932 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437e24d-7c2b-4fda-868f-62a87ab4283c None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:23.652427 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437e24d-7c2b-4fda-868f-62a87ab4283c None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:23.652531 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437e24d-7c2b-4fda-868f-62a87ab4283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:23.672282 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-4437e24d-7c2b-4fda-868f-62a87ab4283c None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:23.673733 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-4437e24d-7c2b-4fda-868f-62a87ab4283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:23.682925 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1465/2923] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:23.697668 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:23.709272 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aba99d-2af6-4067-9883-14a3156209de service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:23.714955 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40020538-d904-4a22-9ccb-ff9b7d88af33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:23.715545 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40020538-d904-4a22-9ccb-ff9b7d88af33 service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:23.715820 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40020538-d904-4a22-9ccb-ff9b7d88af33 service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:23.716089 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40020538-d904-4a22-9ccb-ff9b7d88af33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:23.725049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40020538-d904-4a22-9ccb-ff9b7d88af33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:23.726625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40020538-d904-4a22-9ccb-ff9b7d88af33 service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:23.735902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1459/2924] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:01:33.666942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=32 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:01:33.731804 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:01:39.839292 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] REQUEST_METHOD: `POST` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:39.839799 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:39.839910 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:39.858196 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.auth.core [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] MFA Rules not processed for user `fee45ae313ff41c29b1524ffd0e926af`. Rule list: `[]` (Enabled: `True`). {{(pid=88132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:39.859422 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:39.914445 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1466/2925] 10.222.0.27 () {58 vars in 958 bytes} [Wed Sep 14 03:01:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:49.907782 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=25 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:01:57.025819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f8a5-c11f-4fdb-9695-b9eebd919093 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:57.026362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f8a5-c11f-4fdb-9695-b9eebd919093 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:57.026362 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f8a5-c11f-4fdb-9695-b9eebd919093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:57.045569 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-8cd2f8a5-c11f-4fdb-9695-b9eebd919093 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:01:57.046780 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-8cd2f8a5-c11f-4fdb-9695-b9eebd919093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:57.054861 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1460/2926] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:01:57.069646 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:01:57.071586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:01:57.088045 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca2cc-a61c-403b-9d7e-32e472110300 None None] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:01:57.093861 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:01:57.094490 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:01:57.094779 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:01:57.095047 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:01:57.103690 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:01:57.105244 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:01:57.115065 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1467/2927] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:00.543117 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ddbce-426c-46c9-ac2f-f4fc683a23b3 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:00.543628 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ddbce-426c-46c9-ac2f-f4fc683a23b3 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:00.543762 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ddbce-426c-46c9-ac2f-f4fc683a23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:00.564345 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ec3ddbce-426c-46c9-ac2f-f4fc683a23b3 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:02:00.568392 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ec3ddbce-426c-46c9-ac2f-f4fc683a23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:00.574590 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1461/2928] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 03:02:00.590306 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:00.601928 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce210db-d03b-4c21-9572-8ccc3782d367 service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:00.607894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:00.608484 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:00.608765 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:00.609037 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:00.617444 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:00.623053 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:00.628785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1468/2929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:03.458868 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83645e-6944-4fe6-ab6b-3d61d3639004 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:03.459358 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83645e-6944-4fe6-ab6b-3d61d3639004 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:03.459460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83645e-6944-4fe6-ab6b-3d61d3639004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:03.478687 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-ca83645e-6944-4fe6-ab6b-3d61d3639004 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:02:03.479924 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-ca83645e-6944-4fe6-ab6b-3d61d3639004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:03.487625 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1462/2930] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:02:03.504419 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:03.516583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f6feb-d664-42ad-89b4-ee6dc46fc432 service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:03.522112 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:03.525377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:03.525377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:03.525377 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:03.532095 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:03.533702 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:03.543598 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1469/2931] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:06.681647 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40faf-ab7b-4367-8a7a-84324980a9ee None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:06.682177 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40faf-ab7b-4367-8a7a-84324980a9ee None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:06.682289 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40faf-ab7b-4367-8a7a-84324980a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:06.701484 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-10b40faf-ab7b-4367-8a7a-84324980a9ee None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:02:06.702703 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-10b40faf-ab7b-4367-8a7a-84324980a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:06.710373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1463/2932] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:02:06.729542 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:06.740767 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1669d7e-b182-4853-a778-9ffe83f5b8f0 service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:06.747115 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:06.747876 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:06.748155 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:06.748425 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:06.756695 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:06.758319 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:06.767851 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1470/2933] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:09.908136 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] REQUEST_METHOD: `POST` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:09.908584 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:09.908686 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:09.929539 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.auth.core [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] MFA Rules not processed for user `fb28b21d104a41698326c53a88a850ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 03:02:09.931638 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:09.939411 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1464/2934] 10.222.0.23 () {58 vars in 1016 bytes} [Wed Sep 14 03:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 03:02:09.954880 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:09.966722 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a77a5-56c6-4a77-ba4a-fa365b6cf3ab service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:09.972214 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:09.972795 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:09.973073 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:09.973342 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:09.981537 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:09.983167 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:09.993105 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1471/2935] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:13.023017 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:13.024441 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:13.080494 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876eba7-441b-4308-ac16-80bc7ba186f9 None None] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:13.084016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1aaf929efbc4f818d2f0b133d449f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:13.084619 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:13.084904 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:13.085179 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:13.087373 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:13.101049 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:13.102493 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:13.113250 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1465/2936] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:16.034298 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:16.035785 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:16.100433 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3cbd-2a6c-43f8-ada4-d0663d50a019 service nova] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:16.104979 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:16.105591 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:16.105879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:16.106147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:16.107896 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:16.121429 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:16.122894 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:16.133815 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1472/2937] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:23.109731 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=41 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:26.128857 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=56 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:42.274707 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:42.276134 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:42.289691 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f443-b744-4d8e-addf-e29de56249c5 service cinder] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:42.294847 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:42.295460 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:42.295737 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:42.296024 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] PATH_INFO: `/v3/users/fee45ae313ff41c29b1524ffd0e926af` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:42.297101 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee45ae313ff41c29b1524ffd0e926af)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:42.299055 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:42.441400 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee45ae313ff41c29b1524ffd0e926af'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:42.442046 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee45ae313ff41c29b1524ffd0e926af'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:42.503851 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee45ae313ff41c29b1524ffd0e926af'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:42.504470 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee45ae313ff41c29b1524ffd0e926af'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:42.517542 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee45ae313ff41c29b1524ffd0e926af'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:42.530766 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1466/2938] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:02:42 2022] DELETE /identity/v3/users/fee45ae313ff41c29b1524ffd0e926af => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:02:42.858346 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:42.869436 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bb97d-8447-4c13-a7ea-1b663e0c6cb1 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:42.928417 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:42.929043 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:42.929317 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:42.929583 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] PATH_INFO: `/v3/projects/11ef8ff59b124a1abac92e8665016f13` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:42.930714 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ef8ff59b124a1abac92e8665016f13)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:42.932586 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:43.038363 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ef8ff59b124a1abac92e8665016f13', 'request_id': 'req-760c8ac5-3293-4a31-bb9c-1475b38ddf77'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:43.045141 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ef8ff59b124a1abac92e8665016f13', 'request_id': 'req-760c8ac5-3293-4a31-bb9c-1475b38ddf77'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:43.130711 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ef8ff59b124a1abac92e8665016f13', 'request_id': 'req-760c8ac5-3293-4a31-bb9c-1475b38ddf77'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:43.142232 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] The token cache is being invalidate because project 11ef8ff59b124a1abac92e8665016f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:02:43.142548 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:43.143173 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:43.144653 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1473/2939] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:02:42 2022] DELETE /identity/v3/projects/11ef8ff59b124a1abac92e8665016f13 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:02:44.726233 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:44.727771 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:44.813516 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2f7c5-868c-4f56-ab46-3fe6cfb70595 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:44.881867 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab0aa1e574a4549a1643bf0674df5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:44.882394 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:44.882704 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:44.882977 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:44.884719 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:44.894887 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:44.897716 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:44.899254 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:44.910898 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1467/2940] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:44.982726 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:44.984288 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:45.049111 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8ac5-3293-4a31-bb9c-1475b38ddf77 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:45.049942 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33c2eed340e0484880b561af4084ab7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:45.050438 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] REQUEST_METHOD: `GET` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:45.050662 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:45.050938 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:45.053014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:45.064183 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:45.065652 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:45.076121 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1474/2941] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:02:55.072041 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:55.246769 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=2 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:57.279594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:57.279594 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:57.344732 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3d9ec-94ce-45da-b106-272c763dab0f service nova] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:57.349277 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:57.349902 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:57.350183 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:57.350458 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] PATH_INFO: `/v3/users/b530505d0762441593993d9f87a3ad78` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:57.351610 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b530505d0762441593993d9f87a3ad78)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:57.353524 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:57.522819 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b530505d0762441593993d9f87a3ad78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:57.523398 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b530505d0762441593993d9f87a3ad78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:57.589944 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b530505d0762441593993d9f87a3ad78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:57.590597 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b530505d0762441593993d9f87a3ad78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:57.603720 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b530505d0762441593993d9f87a3ad78'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:57.616453 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1468/2942] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:02:57 2022] DELETE /identity/v3/users/b530505d0762441593993d9f87a3ad78 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:02:57.866035 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:57.879022 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dbb33-f897-43f2-b293-51de4e3fb591 service neutron] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:57.938051 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:57.938602 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:57.938879 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:57.939147 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] PATH_INFO: `/v3/projects/8af87cd85acd453fac7b3b4f386c8789` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:57.940265 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af87cd85acd453fac7b3b4f386c8789)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:57.942139 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:58.057132 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af87cd85acd453fac7b3b4f386c8789', 'request_id': 'req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.063476 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af87cd85acd453fac7b3b4f386c8789', 'request_id': 'req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.130327 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af87cd85acd453fac7b3b4f386c8789', 'request_id': 'req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.141776 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] The token cache is being invalidate because project 8af87cd85acd453fac7b3b4f386c8789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:02:58.142082 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.142751 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.144271 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1475/2943] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:02:57 2022] DELETE /identity/v3/projects/8af87cd85acd453fac7b3b4f386c8789 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:02:58.148295 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:58.149708 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:58.162960 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff617c-f799-4a73-9c9a-b0d6a11771e7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:58.219629 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:58.220279 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:58.220564 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:58.220865 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] PATH_INFO: `/v3/users/5dd3f860a2984731a26b5cf15b5756b6` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:58.222016 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd3f860a2984731a26b5cf15b5756b6)` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:58.223966 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:58.245673 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:58.421237 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd3f860a2984731a26b5cf15b5756b6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.421913 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd3f860a2984731a26b5cf15b5756b6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.481376 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd3f860a2984731a26b5cf15b5756b6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.482815 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd3f860a2984731a26b5cf15b5756b6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.495355 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.notifications [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd3f860a2984731a26b5cf15b5756b6'} {{(pid=88131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.507462 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1469/2944] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Sep 14 03:02:58 2022] DELETE /identity/v3/users/5dd3f860a2984731a26b5cf15b5756b6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:02:58.760261 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Authenticating user token {{(pid=88132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:02:58.761721 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.fernet_utils [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:02:58.775875 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1b52d-2c4c-40f9-8c3f-fc5a95aced00 admin admin] Validating token access rules against request {{(pid=88132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:02:58.834064 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb28b21d104a41698326c53a88a850ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08712a2fc7d14bcea78d3e24178be8ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:02:58.834735 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:02:58.835015 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:02:58.835287 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] PATH_INFO: `/v3/projects/ac2a7b0878d5455e92dbaa1032894143` {{(pid=88132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:02:58.836430 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2a7b0878d5455e92dbaa1032894143)` {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:02:58.838367 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] RBAC: Authorization granted {{(pid=88132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:02:58.949097 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:02:58.961224 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2a7b0878d5455e92dbaa1032894143', 'request_id': 'req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:58.967825 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2a7b0878d5455e92dbaa1032894143', 'request_id': 'req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:59.056014 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2a7b0878d5455e92dbaa1032894143', 'request_id': 'req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27'} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:59.067364 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] The token cache is being invalidate because project ac2a7b0878d5455e92dbaa1032894143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 03:02:59.067842 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:59.069513 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG keystone.notifications [None req-4832e5fd-7d5b-4d25-8ffb-0ac1893bea27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 03:02:59.071072 dv-cinder-857075-6-smb devstack@keystone.service[88132]: [pid: 88132|app: 0|req: 1476/2945] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Sep 14 03:02:58 2022] DELETE /identity/v3/projects/ac2a7b0878d5455e92dbaa1032894143 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 03:03:08.503922 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:03:09.125231 dv-cinder-857075-6-smb devstack@keystone.service[88132]: DEBUG dbcounter [-] [88132] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 03:06:13.706159 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Authenticating user token {{(pid=88131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 03:06:13.707575 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:06:13.779082 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53731-03a8-4c99-b012-f4e36de25db7 admin admin] Validating token access rules against request {{(pid=88131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 03:06:13.837645 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01bcb3dcd2054cc3a8f03990d4dc0781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a636ce482b24a09a051c2c70ab78db4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 03:06:13.838247 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] REQUEST_METHOD: `GET` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 03:06:13.838560 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] SCRIPT_NAME: `/identity` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 03:06:13.838834 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 03:06:13.840549 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.fernet_utils [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 03:06:13.851555 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 03:06:13.853122 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d6c50-52b4-4936-8240-88d5f3335c8f service placement] RBAC: Authorization granted {{(pid=88131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 03:06:13.863637 dv-cinder-857075-6-smb devstack@keystone.service[88131]: [pid: 88131|app: 0|req: 1470/2946] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Sep 14 03:06:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 03:06:23.859299 dv-cinder-857075-6-smb devstack@keystone.service[88131]: DEBUG dbcounter [-] [88131] Writing DB stats keystone:SELECT=58 {{(pid=88131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}